-- Logs begin at Tue 2022-09-06 11:07:26 UTC, end at Tue 2022-09-06 12:43:21 UTC. -- Sep 06 11:41:11.525725 dv-cinder-856041-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 11:41:11.537936 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 11:41:11 2022] *** Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: nodename: dv-cinder-856041-1-iscsi Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: machine: x86_64 Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: clock source: unix Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: pcre jit disabled Sep 06 11:41:11.539376 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: detected number of CPU cores: 4 Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: current working directory: / Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: detected binary path: /usr/bin/uwsgi-core Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: your processes number limit is 47680 Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: your memory page size is 4096 bytes Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: detected max file descriptor number: 2048 Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: lock engine: pthread robust mutexes Sep 06 11:41:11.539864 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: thunder lock: enabled Sep 06 11:41:11.540254 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 11:41:11.540254 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 11:41:11.604123 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: Python main interpreter initialized at 0x5580fa7279c0 Sep 06 11:41:11.604123 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: python threads support enabled Sep 06 11:41:11.604123 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: your server socket listen backlog is limited to 100 connections Sep 06 11:41:11.604123 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: your mercy for graceful operations on workers is 90 seconds Sep 06 11:41:11.604697 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 11:41:11.604832 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: *** Operational MODE: preforking *** Sep 06 11:41:11.605309 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: *** uWSGI is running in multiple interpreter mode *** Sep 06 11:41:11.605309 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: spawned uWSGI master process (pid: 112056) Sep 06 11:41:11.605592 dv-cinder-856041-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 11:41:11.607874 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: spawned uWSGI worker 1 (pid: 112070, cores: 1) Sep 06 11:41:11.607874 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: spawned uWSGI worker 2 (pid: 112071, cores: 1) Sep 06 11:41:11.607874 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 11:41:12.353525 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 11:41:12.359313 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 11:41:13.494934 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:41:13.494934 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: from cryptography.utils import int_from_bytes Sep 06 11:41:13.495830 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:41:13.495830 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: from cryptography.utils import int_from_bytes Sep 06 11:41:14.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:41:14.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: from cryptography.utils import int_from_bytes Sep 06 11:41:14.114012 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:41:14.114012 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: from cryptography.utils import int_from_bytes Sep 06 11:41:16.239234 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 11:41:16.240105 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 11:41:16.240492 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 11:41:16.240959 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 11:41:16.241370 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 11:41:16.241900 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.242442 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.242930 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.243355 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.243813 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.244224 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.244654 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.245068 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.245570 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.245977 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.246406 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.246940 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-1-iscsi {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.248397 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.248593 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.248949 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.249397 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.249872 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.250346 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.250882 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.251564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.252240 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.252776 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.253291 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.253782 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.254199 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.254606 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.255022 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.255509 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.256004 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.256447 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.257119 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-1-iscsi {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.257629 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.258151 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.258587 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.259141 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.259647 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.260139 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.260615 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.261377 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.261927 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.262385 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.263022 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.264172 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.264172 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.264722 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.265177 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.265732 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.266181 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.266628 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.267214 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.267500 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.268033 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.268492 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.269009 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.269461 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.269881 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.270252 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.270696 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.271137 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.271605 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.272051 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.272484 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.272915 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.273513 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.273928 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.274408 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.274821 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.275265 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.275681 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.276185 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.276601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.277026 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.277618 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.278073 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.279015 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.280080 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.280080 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.280650 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.281076 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.281497 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.281946 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.282371 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.282804 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.283224 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.283725 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.284140 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.284493 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.284907 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.285319 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.285775 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.286182 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.286594 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.287004 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.287435 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.287853 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.288335 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.288742 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.289145 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.289555 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.289993 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.290395 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.290805 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.291218 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.291622 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.292049 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.292464 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.292898 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.293300 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.293841 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.294317 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.295895 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.295895 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.296411 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.296839 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.297248 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.297676 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.298124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.298605 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.299069 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.299494 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.299899 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.300305 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.300729 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.301132 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.301536 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.301973 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.302376 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.302787 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.303188 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.303596 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.304069 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.304467 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.304883 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.305304 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.305762 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.306168 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.306570 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.306987 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.307459 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.307952 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.308423 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.308907 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.309336 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.310440 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.311613 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.311613 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.312072 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.312502 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.312914 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.313332 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.313795 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.314232 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.314646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.315073 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.315494 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.315911 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.316336 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.316753 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.317197 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.317628 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.318173 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.318587 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.319105 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.319550 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.319965 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.320388 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.320815 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.321226 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.321708 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.322102 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.322541 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.322958 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.323377 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.323804 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.324240 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.324667 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.325079 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.327033 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.327033 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.327519 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.327931 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.328447 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.328873 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.329361 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.329815 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.330267 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.330686 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.331098 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.331509 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.331925 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.332332 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.332745 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.333153 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.333564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.334005 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.334494 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.334975 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.335387 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.335816 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.336220 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.336629 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.337038 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.337456 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.337906 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.338348 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.338773 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.339178 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.339633 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.340053 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.340463 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.340905 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.342267 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.342837 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.343259 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.343686 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.344102 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.344547 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.344962 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.345392 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.345860 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.346272 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.346718 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.347157 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.347568 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.347994 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.348428 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.348845 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.349245 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.349695 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.350100 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.350511 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.350919 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.351335 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.351735 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.352139 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.352540 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.352942 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.353350 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.353816 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.354237 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.354641 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.355081 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.355491 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.355961 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.356365 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.356872 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.357513 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.357970 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.358402 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.358817 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.359258 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.359665 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.360084 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.360493 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.360911 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.361329 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.361848 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.362269 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.362679 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.363103 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.363606 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.364033 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.364497 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.364913 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.365379 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.365847 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.366275 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.366697 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.367105 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.367519 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.367957 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.368412 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.368828 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.369234 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.369698 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.370118 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.370536 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.370956 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.371384 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.371799 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.372218 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.373866 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.373866 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.374327 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.374773 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.375188 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.375599 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.376019 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.376426 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.376842 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.377250 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.377676 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.378091 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.378501 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.378923 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.379408 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.379817 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.380226 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.380635 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.381041 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.381447 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.381889 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.382309 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.382735 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.383143 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.383569 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.383996 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.384400 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.384845 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.385271 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.385989 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.386416 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.386831 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.387234 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.387679 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.388147 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.389280 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.389280 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.389830 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.390267 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.390707 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.391123 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.391576 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.392005 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.392335 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.392745 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.393157 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.393565 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.394008 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.394498 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.394940 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.395349 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.395822 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.396237 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.396665 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.397083 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.397499 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.398213 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.398643 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.399119 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.399534 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.400051 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.400480 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.400947 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.401380 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.401837 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.402343 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.402752 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.403164 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.404136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.405053 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.405371 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.405768 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.406319 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.406763 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.407189 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.407599 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.408002 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.408486 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.408970 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.409407 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.409869 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.410275 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.410712 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.411122 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.411529 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.411943 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.412345 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.412794 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.413195 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.413627 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.414086 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.414531 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.414939 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.415340 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.415762 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.416165 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.416574 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.417002 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.417430 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.417887 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.418296 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.418710 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.419152 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.419792 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.420692 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.420692 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.421195 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.421607 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.422059 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.422473 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.422948 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.423352 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.423823 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.424240 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.424733 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.425145 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.425629 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.426081 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.426531 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.426946 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.427347 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.427764 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.428174 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.428601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.429027 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.429456 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.429909 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.430384 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.430795 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.431246 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.431740 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.432150 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.432580 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.433056 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.433460 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.433932 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.434354 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.435631 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.436017 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.436509 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.436945 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.437359 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.437817 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.438293 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.438779 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.439210 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.439648 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.440060 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.440474 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.440924 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.441397 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.441858 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.442342 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.442762 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.443177 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.443595 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.444008 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.444423 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.444839 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.445251 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.445699 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.446040 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.446365 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.446758 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.447078 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.447536 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.449429 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.449429 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.449429 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.449927 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.450359 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.450972 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.451493 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.452045 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.452602 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.453169 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.453753 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.454337 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.454920 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.455504 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.456085 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.456654 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.457216 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.457820 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.458395 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.458949 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.459561 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.460128 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.460690 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.461265 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.461861 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.462450 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.463024 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.463838 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.464430 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.464971 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.465301 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.465629 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.466488 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.467007 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.467708 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.467938 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.468396 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.468725 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.469049 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.469372 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.469707 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.470026 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.470343 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.470672 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.470983 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.471293 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.471600 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.471927 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.472234 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.472559 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.472989 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.473303 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.473611 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.474053 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.474368 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.474690 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.475012 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.475337 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.475667 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.475976 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.476294 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.476607 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.476933 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.477259 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.477573 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.477922 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.478230 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.478557 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.478882 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.479200 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.479522 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.479954 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.480281 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.480597 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.480923 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.481249 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.481800 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.482007 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.482479 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.482944 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.483261 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.483590 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.483899 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.484215 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.484534 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.484849 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.485157 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.485462 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.485817 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.486120 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.486444 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.486762 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.487084 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.487406 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.487715 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.488035 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.488347 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.488650 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.488955 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.489323 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.489607 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.489939 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.490263 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.490592 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.490919 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.491227 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.491562 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.491892 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.492213 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.492525 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.492844 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.493167 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.493471 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.493803 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.494113 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.494421 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.494723 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.495023 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.495329 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.495628 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.495930 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.496231 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.496552 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.496853 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.497781 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.498215 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.498699 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.499239 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.499809 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.500440 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.500992 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.501601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.502200 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.502797 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.503377 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.504052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.504458 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.504802 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.505132 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.505478 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.505842 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.506163 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.506495 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.506820 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.507143 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.507730 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.508068 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.508393 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.508714 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.509032 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.509350 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.509689 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.510012 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.510328 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.510643 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.511211 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.511548 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.511869 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.512199 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.512538 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.513867 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.514069 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.514546 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.514923 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.515299 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.515625 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.515938 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.516258 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.516578 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.516898 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.517211 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.517524 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.517872 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.518188 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.518618 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.518807 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.519127 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.519444 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.519777 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.520115 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.520439 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.520755 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.521069 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.521387 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.522005 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.522324 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.522661 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.523001 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.523308 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.523629 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.523951 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.524283 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.524595 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.524902 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.525216 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.525523 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.525854 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.526181 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.526491 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.526797 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.527118 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.527428 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.528008 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.528362 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.529484 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.530192 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.530918 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.530918 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.531375 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.533989 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.534320 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.536859 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.537306 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.537592 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.540153 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.540508 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.540848 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.541175 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.541492 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.541845 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.542161 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.542502 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.542816 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.543136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.543446 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.543764 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.544269 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.545294 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.546352 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.546352 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.546652 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.546966 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.547285 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.547596 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.547914 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.548268 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.548582 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.548888 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.549226 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.549537 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.549914 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.550193 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.550507 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.550833 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.551150 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.551466 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.551822 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.552141 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.552739 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.553090 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.553416 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.553801 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.554135 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.554443 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.554749 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.555057 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.555381 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.555689 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.556005 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.556315 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.556625 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.556935 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.557245 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.557551 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.557886 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.558195 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.558503 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.558808 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.559116 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.559423 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.560386 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.567306 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.567867 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.568229 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.568575 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.568920 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.569262 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.569592 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.569963 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.570289 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.570607 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.570931 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.571272 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.571594 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.571912 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.572649 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.572974 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.573299 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.573627 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.573968 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.574300 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.574628 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.574946 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.575269 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.576274 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.576622 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.576974 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.577505 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.578005 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.578559 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.579134 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.579461 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.579785 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.580112 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.580430 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.580769 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.581045 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.581361 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.581686 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.582005 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.582311 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.582675 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.582930 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.583242 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.583541 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.583846 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.584147 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.584452 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.584791 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.585097 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.585402 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.585729 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.586037 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.586343 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.586640 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.586979 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.587317 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.587632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.587953 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.588267 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.588586 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.588894 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.589214 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.589534 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.589889 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.590200 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.590535 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.590949 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.591671 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.592089 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.592626 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.593056 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.593373 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.593740 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.594076 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.594385 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.594714 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.595034 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.595358 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.595676 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.595989 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.596319 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.596630 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.596943 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.597250 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.597566 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.597902 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.598218 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.598528 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.598840 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.599157 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.599471 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.599805 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.600127 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.600437 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.600767 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.601137 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.601427 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.601773 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.602125 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.602494 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.602814 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.603126 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.603423 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.603665 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 11:41:16.618452 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 11:41:16.619283 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 11:41:16.619283 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 11:41:16.619585 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 11:41:16.619834 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 11:41:16.620221 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.620541 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.620857 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.621170 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.621514 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.621829 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.622149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.622593 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.622921 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.623182 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.623494 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.623817 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-1-iscsi {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.624219 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.624490 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.624739 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.625057 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.625357 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.625793 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.626005 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.626526 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.626835 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.627142 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.627453 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.627787 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.628117 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.628402 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.628711 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.629015 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.629342 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.629669 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.630092 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-1-iscsi {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.630448 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.630721 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.631035 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.631464 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.631864 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.632076 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.632388 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.632710 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.633024 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.633370 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.633720 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.634043 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.634360 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.634666 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.634972 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.635284 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.635615 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.636158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.636458 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.636702 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.637006 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.637325 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.637666 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.638569 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.638822 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.639069 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.639390 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.639809 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.640125 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.640435 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.640741 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.641047 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.641352 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.641718 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.641992 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.642297 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.642624 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.642938 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.643258 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.643563 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.643880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.644301 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.644548 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.644863 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.645210 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.645525 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.645864 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.646184 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.646506 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.646814 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.647118 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.647424 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.647742 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.648066 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.648364 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.648615 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.648914 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.649220 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.649538 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.649870 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.650177 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.650482 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.650780 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.651084 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.651385 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.651689 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.651992 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.652295 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.652598 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.652902 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.653208 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.653604 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.654134 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.654717 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.655052 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.655360 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.655671 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.655975 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.656282 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.656610 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.656917 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.657220 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.657539 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.657881 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.658187 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.658511 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.658814 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.659118 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.659436 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.659731 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.660039 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.660356 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.660658 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.660962 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.661265 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.661563 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.661895 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.662199 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.662500 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.662795 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.663099 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.663423 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.663744 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.664053 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.664355 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.664660 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.664985 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:41:16.665323 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.665726 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.666025 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.666335 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.666667 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.666998 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.667314 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.667624 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.667938 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.668265 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.668570 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.668880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.669875 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.670391 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.670716 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.671055 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.671372 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.671688 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.672111 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.672362 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.672796 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.672967 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.673339 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.673607 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.673957 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.674304 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.674620 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.674946 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.675274 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.675584 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.675895 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.676201 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.676552 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.676865 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.677171 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.677492 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.677837 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.678163 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.678473 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.678783 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.679092 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.679402 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.679706 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.680106 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.680368 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.680692 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.681008 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.681310 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.681799 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.681956 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.682266 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.682573 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.682880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.683173 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.683664 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.683966 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.684264 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.684587 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.685074 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.685458 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.685921 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.686456 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.687025 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.687601 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.688177 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.688747 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.689332 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.690088 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.690540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.690838 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.691163 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.691485 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.691819 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.692132 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.692444 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.692769 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.693085 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.693407 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.693750 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.694063 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.694407 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.694725 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.695036 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.695377 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.695711 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.696018 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.696343 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.696669 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.696988 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.697289 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.697600 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.697938 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.698245 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.698548 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.698853 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.699154 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.699456 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.699861 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.700075 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.700950 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.701225 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.701579 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.701924 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.702311 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.702619 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.702968 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.703275 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.703622 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.703963 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.704285 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.704607 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.704925 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.705240 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.705554 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.705974 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.706219 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.706532 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.707058 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.707207 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.707595 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.707743 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.708072 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.708382 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.708700 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.709000 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.709315 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.709714 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.710019 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.710337 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.710658 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.710970 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.711282 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.711591 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.711904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.712213 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.712520 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.712837 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.713145 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.713460 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.713808 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.714137 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.714446 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.714764 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.715068 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.715379 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.715710 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.716619 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.716917 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.717344 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.717709 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.718014 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.718329 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.718644 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.718953 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.719264 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.719578 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.719899 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.720208 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.720519 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.720821 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.721135 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.721445 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.721774 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.722112 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.722389 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.722785 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.723043 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.723334 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.723669 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.723953 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.724259 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.724578 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.724883 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.725186 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.725488 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.725821 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.726164 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.726469 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.726771 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.727085 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.727400 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.727706 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.728022 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.728329 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.728737 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.728936 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.729252 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.729553 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.729891 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.730202 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.730519 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.730815 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.731164 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.731475 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.732409 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.732941 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.733339 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.733760 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.734111 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.734707 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.735044 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.735415 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.735662 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.736017 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.736324 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.736655 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.736980 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.737290 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.737597 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.737933 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.738236 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.738538 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.738844 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.739146 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.739516 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.739752 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.740059 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.740357 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.740657 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.740958 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.741257 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.741570 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.741895 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.742208 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.742513 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.742835 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.743141 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.743419 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.743735 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.744035 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.744372 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.744670 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.745009 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.745335 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.745707 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.746005 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.746309 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.746851 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.747061 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.747262 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.748205 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.748593 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.749111 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.749405 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.749749 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.750064 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.750374 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.750686 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.750989 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.751298 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.751600 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.751915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.752219 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.752518 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.752817 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.753127 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.753433 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.753759 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.754067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.754366 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.754676 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.754975 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.755273 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.755580 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.755882 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.756190 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.756486 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.756813 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.757120 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.757417 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.757748 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.758368 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.758368 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.758675 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.758937 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.759255 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.759611 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.759865 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.760175 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.760510 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.761031 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.761330 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.761633 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.761961 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.762262 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.762608 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.762923 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.763121 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO dbcounter [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Registered counter for database nova_api Sep 06 11:41:16.763271 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.763600 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.763892 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.764197 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.764498 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.764804 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.765145 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.765443 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.765830 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.766274 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.766432 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.766744 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.767052 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.767359 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.767668 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.767962 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.768262 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.768575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.768884 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.769183 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.769494 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.769845 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.770142 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.770455 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.770767 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.771089 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.771408 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.771757 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.772001 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.772312 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.772652 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.772964 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.773271 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.773582 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.773921 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.774232 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.774540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.774848 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.775154 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.775464 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.775772 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.776073 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.776399 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.776704 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.777006 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.777313 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.777616 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.777947 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.778252 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.778759 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.779282 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.779866 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.779866 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.780677 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.780677 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.780677 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.781113 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.781113 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.781546 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.781887 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.782197 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.782506 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.782809 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.783110 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.783417 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.783741 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.784041 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.784340 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.784641 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.784961 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.785262 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.785587 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.786049 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.786361 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.786665 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.786820 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_db.sqlalchemy.engines [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:16.787075 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.787386 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.787693 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.788015 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.788387 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.788664 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.788967 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.789281 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.789587 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.789942 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.790260 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.790573 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.790886 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.791187 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.791506 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.791823 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.792133 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.792448 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.792876 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.793194 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.793501 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.793865 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.794783 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writer thread running {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:16.794944 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.795095 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.795593 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.796078 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.796387 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.796696 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.802168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803318 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.803915 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.804437 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.804437 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.804567 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.804887 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.805217 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.805591 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.805944 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.806274 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.806578 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.806878 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.807183 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.807488 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.807790 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.808093 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.808400 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.808699 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.809002 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.809309 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.810519 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.810637 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.810876 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.811190 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.811491 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.811795 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.812098 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.812434 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.812735 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.813057 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.813365 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.813716 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.814031 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.814338 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.814653 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.814963 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.815279 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.815592 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.815906 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.816214 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.816529 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.816842 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.817157 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.817771 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.818101 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.818415 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.818724 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.819037 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.819351 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.819662 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.819975 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.820287 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.820595 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.820903 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.821235 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.821557 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.821924 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.822263 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.822757 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.822969 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.823199 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.823587 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.823871 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.824186 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.824494 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.824802 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.825122 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.825491 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.825832 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.826146 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.826459 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.826773 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.827081 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.827391 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.827705 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.828011 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.828334 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.828669 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.828989 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.829304 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.829616 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.829954 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.830517 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.830826 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.831156 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.831475 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.831796 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.832108 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.832422 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.832745 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.833048 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.833347 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.833754 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.833974 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.834279 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.834601 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.834906 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.835214 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.835531 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.835842 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.836422 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.836770 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.837091 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.837397 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.837749 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.838065 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.838365 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.838684 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.838988 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.839311 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.839600 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.839938 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.840210 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.840552 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.840818 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.841257 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.841749 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.841972 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.842350 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.842688 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.842991 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.843293 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.843590 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.843898 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.844199 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.844498 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.844800 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.845101 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.845415 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.845737 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.846219 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.846527 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.846838 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.847196 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.847506 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.847811 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.848145 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.848448 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.848759 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.849076 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.849467 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.849747 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.850035 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.850344 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.850752 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.851021 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.851599 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.851934 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.852250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.852587 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.852940 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.853218 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.853516 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.853851 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.854174 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.854481 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.854788 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.855094 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.855400 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.855718 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.856023 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.856416 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.857574 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.857988 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.858441 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.858897 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.859346 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.859802 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.860250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.860714 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.861204 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.861696 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.862155 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.862612 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.863078 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.863663 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.864035 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.864489 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.864938 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.865394 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.866128 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.866526 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.867040 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.867928 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.868398 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.868891 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.869360 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.869859 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.context [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5389d5db-2fbe-430b-a0d6-b470d1cc30cf(cell1) {{(pid=112070) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 11:41:16.870024 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.870418 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.870887 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.871350 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.871822 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.872604 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.872997 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.873485 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.874057 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.874538 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.874985 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.875430 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.875874 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.876175 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:16.876432 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.876746 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:16.876910 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.877269 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.877710 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.878067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.878441 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:16.878607 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.878863 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.879241 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.879465 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:16.879665 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.879814 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:16.880098 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.880478 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.880851 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.881222 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.881592 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.881801 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:16.882050 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.882422 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.882792 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.883167 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.883539 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.883942 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO dbcounter [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Registered counter for database nova_cell0 Sep 06 11:41:16.884105 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.884402 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.884776 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.885227 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.886000 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.886551 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.886994 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.887455 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.888460 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.888933 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.889404 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.889838 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO dbcounter [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Registered counter for database nova_cell1 Sep 06 11:41:16.889997 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.890459 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.890921 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.891378 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.891857 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.892392 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.892900 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.893276 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.893818 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.894364 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.894897 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.895426 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.895952 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.896488 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.897078 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.897680 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.898195 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.898694 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.899225 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.899650 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_db.sqlalchemy.engines [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:16.899940 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.900227 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.900779 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.901331 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.901917 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.902444 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.902951 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.903511 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.903990 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_db.sqlalchemy.engines [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:16.904148 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.904495 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.904935 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.905453 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.905975 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.906432 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.906925 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.907422 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.907857 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.908249 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.908744 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.909208 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.909687 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.910228 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.910689 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:41:16.911066 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 11:41:16.911682 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writer thread running {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:16.913824 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writer thread running {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:17.072169 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO dbcounter [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Registered counter for database nova_api Sep 06 11:41:17.077832 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO dbcounter [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Registered counter for database nova_cell0 Sep 06 11:41:17.086731 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_db.sqlalchemy.engines [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:17.093630 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writer thread running {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:17.099364 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_db.sqlalchemy.engines [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:17.108398 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writer thread running {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:17.172925 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.context [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5389d5db-2fbe-430b-a0d6-b470d1cc30cf(cell1) {{(pid=112071) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 11:41:17.177273 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_concurrency.lockutils [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:17.177944 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_concurrency.lockutils [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:17.179821 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_concurrency.lockutils [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:17.180801 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_concurrency.lockutils [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:41:17.181328 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_concurrency.lockutils [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:41:17.183636 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_concurrency.lockutils [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:41:17.186702 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO dbcounter [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Registered counter for database nova_cell0 Sep 06 11:41:17.191787 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO dbcounter [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Registered counter for database nova_cell1 Sep 06 11:41:17.205125 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_db.sqlalchemy.engines [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:17.206471 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_db.sqlalchemy.engines [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:17.216542 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writer thread running {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:17.219167 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writer thread running {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:17.373325 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO dbcounter [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Registered counter for database nova_cell0 Sep 06 11:41:17.383021 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG oslo_db.sqlalchemy.engines [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:41:17.389431 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writer thread running {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:41:17.528720 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: WARNING keystonemiddleware.auth_token [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:41:17.536778 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: WARNING keystonemiddleware.auth_token [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:41:17.739221 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: WARNING keystonemiddleware.auth_token [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:41:17.748424 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: WARNING keystonemiddleware.auth_token [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:41:17.906708 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: WARNING keystonemiddleware.auth_token [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:41:17.912950 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: WARNING keystonemiddleware.auth_token [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:41:17.918889 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580fa7279c0 pid: 112070 (default app) Sep 06 11:41:17.922039 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:41:17.923266 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001969 Sep 06 11:41:17.923696 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Sep 6 11:41:17 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:41:18.120766 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: WARNING keystonemiddleware.auth_token [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:41:18.127196 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: WARNING keystonemiddleware.auth_token [None req-2f4b5979-54fe-442e-b015-bb4c24f5477a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:41:18.132926 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5580fa7279c0 pid: 112071 (default app) Sep 06 11:42:53.173399 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:53.175264 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002683 Sep 06 11:42:53.175993 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:42:53.207394 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_api:SELECT=3 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:53.210788 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_cell0:SELECT=3 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:53.212675 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_cell1:SELECT=3 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:53.213973 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_cell0:SELECT=3 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:54.623016 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-cebab508-4f1f-4e88-a6cc-b4d7b32bcffe admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:54.680437 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-cebab508-4f1f-4e88-a6cc-b4d7b32bcffe admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.491451 Sep 06 11:42:54.681025 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 6 11:42:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:42:57.771089 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:42:57.771857 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-79b2dcb9-aed2-4471-b352-3ef313f66e2b None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 06 11:42:57.774217 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:42:58.500330 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-2bfa71ab-7d97-4e5f-982c-86dea7e0e368 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:58.595556 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-2bfa71ab-7d97-4e5f-982c-86dea7e0e368 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.814943 Sep 06 11:42:58.596709 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:42:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:42:58.621224 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_api:SELECT=3 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:58.622034 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_cell1:SELECT=3 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:58.624093 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_cell0:SELECT=3 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:58.625312 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:58.855717 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-4823e92c-3088-4d16-aabc-83e1d156554f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:42:58.943959 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-4823e92c-3088-4d16-aabc-83e1d156554f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331085 Sep 06 11:42:58.944907 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 6 11:42:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:02.584414 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-2bfa71ab-7d97-4e5f-982c-86dea7e0e368 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:02.586479 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-2bfa71ab-7d97-4e5f-982c-86dea7e0e368 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002683 Sep 06 11:43:02.587512 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:03.400639 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a31bf567-2034-49a2-8623-d4d153fc55af admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:03.472849 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-a31bf567-2034-49a2-8623-d4d153fc55af admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.876319 Sep 06 11:43:03.474029 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:43:03.495173 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-c4ed18cd-7947-4d41-8fea-38c35cf0fe7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:03.574087 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-c4ed18cd-7947-4d41-8fea-38c35cf0fe7d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086043 Sep 06 11:43:03.574998 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 6 11:43:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:06.663792 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a31bf567-2034-49a2-8623-d4d153fc55af admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:06.664815 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-a31bf567-2034-49a2-8623-d4d153fc55af admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 06 11:43:06.665242 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:07.358067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-038bd506-a7b4-4f60-9eb1-08878331e062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:07.388712 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-038bd506-a7b4-4f60-9eb1-08878331e062 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716026 Sep 06 11:43:07.389738 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:07.410167 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-f8609037-7ac8-4002-9d2d-8b875f2049b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:07.449604 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-f8609037-7ac8-4002-9d2d-8b875f2049b8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045568 Sep 06 11:43:07.450580 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 6 11:43:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:10.785806 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-038bd506-a7b4-4f60-9eb1-08878331e062 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:10.786791 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-038bd506-a7b4-4f60-9eb1-08878331e062 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Sep 06 11:43:10.788539 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:11.616058 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-f3f63187-5fd3-4e96-bc6f-ef3a75f6f55f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:11.660391 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-f3f63187-5fd3-4e96-bc6f-ef3a75f6f55f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.864586 Sep 06 11:43:11.670276 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:43:11.684236 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-168fa856-e356-42fe-9216-ede78802daa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:11.730886 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-168fa856-e356-42fe-9216-ede78802daa3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053099 Sep 06 11:43:11.733204 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 6 11:43:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:14.589666 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-f3f63187-5fd3-4e96-bc6f-ef3a75f6f55f admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:14.590988 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-f3f63187-5fd3-4e96-bc6f-ef3a75f6f55f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Sep 06 11:43:14.591893 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:43:15.198071 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-15b58cc2-156e-4927-8f34-97bf2d9c704f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:15.222438 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-15b58cc2-156e-4927-8f34-97bf2d9c704f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.623084 Sep 06 11:43:15.223622 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:15.243545 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-f997333a-ca72-4df8-b08d-68323b12e643 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:15.274061 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-f997333a-ca72-4df8-b08d-68323b12e643 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034405 Sep 06 11:43:15.275404 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 6 11:43:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:18.488962 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-15b58cc2-156e-4927-8f34-97bf2d9c704f admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:18.489895 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-15b58cc2-156e-4927-8f34-97bf2d9c704f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 06 11:43:18.490310 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:43:19.093530 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-8996da84-cea1-4125-973d-81206aa244fd admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:19.137329 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-8996da84-cea1-4125-973d-81206aa244fd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.639672 Sep 06 11:43:19.138382 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 6 11:43:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:43:21.851168 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-15b58cc2-156e-4927-8f34-97bf2d9c704f admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:21.852121 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-15b58cc2-156e-4927-8f34-97bf2d9c704f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 06 11:43:21.852676 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:43:22.442406 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-e87079b8-60d4-440b-ab99-8603c1b384a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "1", "name": "m1.tiny"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:22.469987 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-e87079b8-60d4-440b-ab99-8603c1b384a8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.609730 Sep 06 11:43:22.470634 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:22.486281 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-8813d6df-3eae-4a95-93e6-49fd2a2df71e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:22.514891 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-8813d6df-3eae-4a95-93e6-49fd2a2df71e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032388 Sep 06 11:43:22.515502 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 6 11:43:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:25.000547 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-e87079b8-60d4-440b-ab99-8603c1b384a8 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:25.001564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-e87079b8-60d4-440b-ab99-8603c1b384a8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 06 11:43:25.002015 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:25.616801 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-2b3fb8c8-7eb5-4e17-8128-bc97d555acb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "id": "2"}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:25.624385 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:25.655796 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-2b3fb8c8-7eb5-4e17-8128-bc97d555acb9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.645485 Sep 06 11:43:25.657015 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:25.679698 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-27b546bd-6d4d-4e40-9c1f-7c3f3bfef4bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:25.727028 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-27b546bd-6d4d-4e40-9c1f-7c3f3bfef4bd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054352 Sep 06 11:43:25.728594 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 6 11:43:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:43:28.731185 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-2b3fb8c8-7eb5-4e17-8128-bc97d555acb9 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:28.732215 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-2b3fb8c8-7eb5-4e17-8128-bc97d555acb9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 06 11:43:28.732637 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:29.405305 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-cc47cb71-0ac2-43b4-bd90-b017dbb20c3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "vcpus": 2, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:29.414349 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:29.433531 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-cc47cb71-0ac2-43b4-bd90-b017dbb20c3b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.693293 Sep 06 11:43:29.434661 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:29.446724 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-aaccbf73-42ed-4273-a31b-e38408a79def admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:29.480722 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-aaccbf73-42ed-4273-a31b-e38408a79def admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037020 Sep 06 11:43:29.494424 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 6 11:43:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:43:32.323399 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-cc47cb71-0ac2-43b4-bd90-b017dbb20c3b admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:32.326004 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-cc47cb71-0ac2-43b4-bd90-b017dbb20c3b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Sep 06 11:43:32.326004 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:32.968948 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-8fbe8ba2-fa76-4212-b9ab-b971f9dd8066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "swap": 0}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:32.993098 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-8fbe8ba2-fa76-4212-b9ab-b971f9dd8066 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.657031 Sep 06 11:43:32.993768 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:33.006798 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-64cd17fb-fbd2-49a2-9b5e-50aad6b29132 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:33.037182 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-64cd17fb-fbd2-49a2-9b5e-50aad6b29132 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034554 Sep 06 11:43:33.038162 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 6 11:43:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:43:35.580950 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-8fbe8ba2-fa76-4212-b9ab-b971f9dd8066 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:35.582005 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-8fbe8ba2-fa76-4212-b9ab-b971f9dd8066 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Sep 06 11:43:35.582605 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:36.144414 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a9f83d2e-ec2a-4302-acc6-c2820c6b641f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge"}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:36.165506 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-a9f83d2e-ec2a-4302-acc6-c2820c6b641f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.574861 Sep 06 11:43:36.166411 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 6 11:43:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:36.178866 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-a1385ee9-1c69-45e1-888c-2b27d4d534d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:36.209698 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-a1385ee9-1c69-45e1-888c-2b27d4d534d5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034427 Sep 06 11:43:36.210775 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 6 11:43:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:43:51.512213 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a9f83d2e-ec2a-4302-acc6-c2820c6b641f admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:51.513469 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-a9f83d2e-ec2a-4302-acc6-c2820c6b641f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 06 11:43:51.513900 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:43:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:51.524722 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:51.916211 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-08048cce-e3f1-44f1-b3f2-5c342cf7119c admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:51.934225 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-08048cce-e3f1-44f1-b3f2-5c342cf7119c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414019 Sep 06 11:43:51.934764 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 6 11:43:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:43:53.025968 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a9f83d2e-ec2a-4302-acc6-c2820c6b641f admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:53.027141 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-a9f83d2e-ec2a-4302-acc6-c2820c6b641f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Sep 06 11:43:53.027510 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:53.567428 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-8bff9e48-c0f0-44a2-b113-e3d5e8afcd0f admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:53.573092 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.wsgi [None req-8bff9e48-c0f0-44a2-b113-e3d5e8afcd0f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-8bff9e48-c0f0-44a2-b113-e3d5e8afcd0f admin admin] Request method failure captured: Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Accept: application/json Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Accept-Encoding: gzip, deflate Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Connection: keep-alive Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Content-Length: 0 Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Host: 10.222.0.18 Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Openstack-Api-Version: compute 2.92 Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Openstack-System-Scope: None Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: User-Agent: python-novaclient Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Auth-Token: gAAAAABjFzJ4bLBLMD8eQUNEYI9FEUKEjSV9fBFRTuhvWV9M0J3UfbmH0L-lqZ5ual_d9_xCT6UrTY4ocx36SlvMBdPE6xFYuOPggNWq_zgOuuV-gd-o31ussLd4URrH6eqAe4qUfSKeY6ldiRlwOt9-gwV45nXocv4QKuiVsJANUXtwQaZzMxI Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Domain-Id: None Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Domain-Name: None Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Identity-Status: Confirmed Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Is-Admin-Project: True Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Domain-Id: default Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Domain-Name: Default Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Name: admin Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Role: admin,member,reader Sep 06 11:43:53.576850 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Roles: admin,member,reader Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}] Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant: admin Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant-Name: admin Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User: admin Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Domain-Id: default Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Domain-Name: Default Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Id: f2212262a5dc4cac8d774b88f87a9ec9 Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Name: admin Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: method: > Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: exception: Flavor 42 could not be found. Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: action_args: {'id': '42'} Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:43:53.578561 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:53.579575 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.580904 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-8bff9e48-c0f0-44a2-b113-e3d5e8afcd0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:43:53.582188 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-8bff9e48-c0f0-44a2-b113-e3d5e8afcd0f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.405088 Sep 06 11:43:53.582188 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 6 11:43:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:53.587933 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-edbbfcb5-a2f1-43d8-8db3-ea25444d24b6 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:53.592227 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:53.612789 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-edbbfcb5-a2f1-43d8-8db3-ea25444d24b6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028329 Sep 06 11:43:53.613338 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 6 11:43:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:43:53.623876 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-3e65696b-0785-4f75-b3f5-45ce8ae1ec7c admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:53.647235 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-3e65696b-0785-4f75-b3f5-45ce8ae1ec7c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027539 Sep 06 11:43:53.647796 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 6 11:43:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:43:53.658443 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-16e162cc-35d0-4f30-a3af-345e6ff305f8 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:53.664949 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.wsgi [None req-16e162cc-35d0-4f30-a3af-345e6ff305f8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-16e162cc-35d0-4f30-a3af-345e6ff305f8 admin admin] Request method failure captured: Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Accept: application/json Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Accept-Encoding: gzip, deflate Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Connection: keep-alive Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Content-Length: 0 Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Host: 10.222.0.18 Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Openstack-Api-Version: compute 2.92 Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Openstack-System-Scope: None Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: User-Agent: python-novaclient Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Auth-Token: gAAAAABjFzJ4bLBLMD8eQUNEYI9FEUKEjSV9fBFRTuhvWV9M0J3UfbmH0L-lqZ5ual_d9_xCT6UrTY4ocx36SlvMBdPE6xFYuOPggNWq_zgOuuV-gd-o31ussLd4URrH6eqAe4qUfSKeY6ldiRlwOt9-gwV45nXocv4QKuiVsJANUXtwQaZzMxI Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Domain-Id: None Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Domain-Name: None Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Identity-Status: Confirmed Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Is-Admin-Project: True Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Domain-Id: default Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Domain-Name: Default Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Name: admin Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Role: admin,member,reader Sep 06 11:43:53.669124 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Roles: admin,member,reader Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}] Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant: admin Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant-Name: admin Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User: admin Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Domain-Id: default Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Domain-Name: Default Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Id: f2212262a5dc4cac8d774b88f87a9ec9 Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Name: admin Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: method: > Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: exception: Flavor 42 could not be found. Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: action_args: {'id': '42'} Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:43:53.670741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:53.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:53.673136 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-16e162cc-35d0-4f30-a3af-345e6ff305f8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:43:53.674406 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-16e162cc-35d0-4f30-a3af-345e6ff305f8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016017 Sep 06 11:43:53.674406 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 6 11:43:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 11:43:54.646204 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-3e65696b-0785-4f75-b3f5-45ce8ae1ec7c admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:54.647222 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-3e65696b-0785-4f75-b3f5-45ce8ae1ec7c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 06 11:43:54.647645 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:55.184054 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-3036b40a-be48-494c-b291-40b48abedead admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:55.189445 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.wsgi [None req-3036b40a-be48-494c-b291-40b48abedead admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-3036b40a-be48-494c-b291-40b48abedead admin admin] Request method failure captured: Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Accept: application/json Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Accept-Encoding: gzip, deflate Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Connection: keep-alive Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Content-Length: 0 Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Host: 10.222.0.18 Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Openstack-Api-Version: compute 2.92 Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Openstack-System-Scope: None Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: User-Agent: python-novaclient Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Auth-Token: gAAAAABjFzJ6r6wAdzw6vbapm8AwH6-pTlVjXSZwH5wL5TRcXUjt-R-WMe4Hn_Bzf2fpxZRjmuyo-Q_97J7E8kEix-eW81IYfUlZwU3Y9pjbz6vuZW5P6M4nT4BjrmrGRZgFahr-Tm7KT5shKsTpKEYn6pDUHvi2N9mrv5GdX7ptpEluXT2NcEA Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Domain-Id: None Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Domain-Name: None Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Identity-Status: Confirmed Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Is-Admin-Project: True Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Domain-Id: default Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Domain-Name: Default Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Name: admin Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Role: admin,member,reader Sep 06 11:43:55.190999 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Roles: admin,member,reader Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}] Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant: admin Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant-Name: admin Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User: admin Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Domain-Id: default Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Domain-Name: Default Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Id: f2212262a5dc4cac8d774b88f87a9ec9 Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Name: admin Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: method: > Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: exception: Flavor 84 could not be found. Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: action_args: {'id': '84'} Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:43:55.192646 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:55.193564 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.195052 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-3036b40a-be48-494c-b291-40b48abedead admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:43:55.196370 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-3036b40a-be48-494c-b291-40b48abedead admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.402961 Sep 06 11:43:55.196370 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 6 11:43:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:55.202622 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-1dab2829-4af5-411d-b055-eda1c6275bf4 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:55.218443 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-1dab2829-4af5-411d-b055-eda1c6275bf4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019110 Sep 06 11:43:55.218991 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 6 11:43:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:43:55.228700 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-897b7ec4-0a53-4129-8198-a4e131830403 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:55.243964 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-897b7ec4-0a53-4129-8198-a4e131830403 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018981 Sep 06 11:43:55.245287 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 6 11:43:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:43:55.254563 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-1aea111e-6dc3-468b-ba45-a351caa12e7c admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:55.260083 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.wsgi [None req-1aea111e-6dc3-468b-ba45-a351caa12e7c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-1aea111e-6dc3-468b-ba45-a351caa12e7c admin admin] Request method failure captured: Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Accept: application/json Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Accept-Encoding: gzip, deflate Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Connection: keep-alive Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Content-Length: 0 Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Host: 10.222.0.18 Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Openstack-Api-Version: compute 2.92 Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Openstack-System-Scope: None Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: User-Agent: python-novaclient Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Auth-Token: gAAAAABjFzJ6r6wAdzw6vbapm8AwH6-pTlVjXSZwH5wL5TRcXUjt-R-WMe4Hn_Bzf2fpxZRjmuyo-Q_97J7E8kEix-eW81IYfUlZwU3Y9pjbz6vuZW5P6M4nT4BjrmrGRZgFahr-Tm7KT5shKsTpKEYn6pDUHvi2N9mrv5GdX7ptpEluXT2NcEA Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Domain-Id: None Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Domain-Name: None Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Identity-Status: Confirmed Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Is-Admin-Project: True Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Domain-Id: default Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Domain-Name: Default Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Name: admin Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Role: admin,member,reader Sep 06 11:43:55.262880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Roles: admin,member,reader Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}] Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant: admin Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant-Name: admin Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User: admin Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Domain-Id: default Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Domain-Name: Default Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Id: f2212262a5dc4cac8d774b88f87a9ec9 Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Name: admin Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: method: > Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: exception: Flavor 84 could not be found. Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: action_args: {'id': '84'} Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:43:55.264468 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:55.265250 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:55.266540 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-1aea111e-6dc3-468b-ba45-a351caa12e7c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:43:55.267768 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-1aea111e-6dc3-468b-ba45-a351caa12e7c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013625 Sep 06 11:43:55.267768 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 6 11:43:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 11:43:56.253220 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-897b7ec4-0a53-4129-8198-a4e131830403 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:56.254286 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-897b7ec4-0a53-4129-8198-a4e131830403 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 06 11:43:56.254703 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:56.801894 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-b96e9594-f2fc-46ee-9b64-f87dc18735d4 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:56.808615 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.wsgi [None req-b96e9594-f2fc-46ee-9b64-f87dc18735d4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-b96e9594-f2fc-46ee-9b64-f87dc18735d4 admin admin] Request method failure captured: Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Accept: application/json Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Accept-Encoding: gzip, deflate Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Connection: keep-alive Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Content-Length: 0 Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Host: 10.222.0.18 Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Openstack-Api-Version: compute 2.92 Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Openstack-System-Scope: None Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: User-Agent: python-novaclient Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Auth-Token: gAAAAABjFzJ8jxEe6TstGlDp-iYQbRmhYOb9dZ82PIC8Z--DF1WXpXW_tYKytMVivDHhoxFhNPWfiUs21zClVNNXb9wc_7WYUwXGRlfjz2TxQ3WmE538bxNtsOCiKYNEBLluI2PKjpYOOAsdj-VkftcEXCyx44Xun5kvQ9FjacnDekjVwlgyV98 Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Domain-Id: None Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Domain-Name: None Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Identity-Status: Confirmed Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Is-Admin-Project: True Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Domain-Id: default Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Domain-Name: Default Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Project-Name: admin Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Role: admin,member,reader Sep 06 11:43:56.810158 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Roles: admin,member,reader Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}] Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant: admin Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-Tenant-Name: admin Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User: admin Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Domain-Id: default Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Domain-Name: Default Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Id: f2212262a5dc4cac8d774b88f87a9ec9 Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: X-User-Name: admin Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: method: > Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: exception: Flavor 451 could not be found. Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: action_args: {'id': '451'} Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:43:56.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:56.814149 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.816067 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-b96e9594-f2fc-46ee-9b64-f87dc18735d4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:43:56.818198 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-b96e9594-f2fc-46ee-9b64-f87dc18735d4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.416790 Sep 06 11:43:56.818198 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 6 11:43:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:56.821308 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-982ab0ec-4e6b-4ef1-a79e-183f3c4df79e admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:56.836867 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-982ab0ec-4e6b-4ef1-a79e-183f3c4df79e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019075 Sep 06 11:43:56.837415 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 6 11:43:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:43:56.848196 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:56.864629 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020049 Sep 06 11:43:56.865457 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 6 11:43:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:43:56.874991 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a39b3c9a-db40-40f6-887e-abab728ebd80 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:56.880226 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.wsgi [None req-a39b3c9a-db40-40f6-887e-abab728ebd80 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a39b3c9a-db40-40f6-887e-abab728ebd80 admin admin] Request method failure captured: Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Accept: application/json Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Accept-Encoding: gzip, deflate Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Connection: keep-alive Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Content-Length: 0 Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Host: 10.222.0.18 Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Openstack-Api-Version: compute 2.92 Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Openstack-System-Scope: None Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: User-Agent: python-novaclient Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Auth-Token: gAAAAABjFzJ8jxEe6TstGlDp-iYQbRmhYOb9dZ82PIC8Z--DF1WXpXW_tYKytMVivDHhoxFhNPWfiUs21zClVNNXb9wc_7WYUwXGRlfjz2TxQ3WmE538bxNtsOCiKYNEBLluI2PKjpYOOAsdj-VkftcEXCyx44Xun5kvQ9FjacnDekjVwlgyV98 Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Domain-Id: None Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Domain-Name: None Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Identity-Status: Confirmed Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Is-Admin-Project: True Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Domain-Id: default Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Domain-Name: Default Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Project-Name: admin Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Role: admin,member,reader Sep 06 11:43:56.881741 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Roles: admin,member,reader Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff9660c7d5b94c33b26aef6fd109810a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff9660c7d5b94c33b26aef6fd109810a"}]}] Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant: admin Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant-Id: ff9660c7d5b94c33b26aef6fd109810a Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-Tenant-Name: admin Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User: admin Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Domain-Id: default Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Domain-Name: Default Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Id: f2212262a5dc4cac8d774b88f87a9ec9 Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: X-User-Name: admin Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: method: > Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: exception: Flavor 451 could not be found. Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: action_args: {'id': '451'} Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:43:56.883364 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:56.884632 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: ERROR nova.api.openstack.wsgi Sep 06 11:43:56.886601 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-a39b3c9a-db40-40f6-887e-abab728ebd80 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:43:56.887826 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-a39b3c9a-db40-40f6-887e-abab728ebd80 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011608 Sep 06 11:43:56.887826 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 6 11:43:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:57.864956 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:57.866085 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 06 11:43:57.866421 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:58.410396 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-c996b7e3-2065-4f74-9140-33711f30d041 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:58.429930 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-c996b7e3-2065-4f74-9140-33711f30d041 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.423564 Sep 06 11:43:58.430478 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 6 11:43:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:43:59.420600 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:43:59.421596 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 06 11:43:59.422023 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:43:59.958040 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-8a551eec-fedc-4865-a8c0-49240c2a93cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:43:59.980012 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-8a551eec-fedc-4865-a8c0-49240c2a93cc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.418540 Sep 06 11:43:59.980479 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 6 11:43:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:44:00.988015 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:44:00.989038 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 06 11:44:00.989439 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:44:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:44:01.576196 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-1fd2f09f-c1e9-4901-ab03-6c4ec7e313a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:44:01.596405 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-1fd2f09f-c1e9-4901-ab03-6c4ec7e313a3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.464290 Sep 06 11:44:01.596958 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 6 11:44:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:44:02.623042 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:44:02.624082 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 06 11:44:02.624483 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:44:03.214985 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-986b811b-dbda-4f75-a92f-2302fa2cab50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:44:03.235354 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-986b811b-dbda-4f75-a92f-2302fa2cab50 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.470871 Sep 06 11:44:03.235916 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 6 11:44:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:44:04.247497 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:44:04.249125 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Sep 06 11:44:04.250326 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:44:04.833424 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-6039215e-622a-41fd-b0c6-b72ad60bf24f admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:44:04.856884 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-6039215e-622a-41fd-b0c6-b72ad60bf24f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.464913 Sep 06 11:44:04.857422 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Sep 6 11:44:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:44:59.766965 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:44:59.767885 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-da9ab761-6ae9-41f1-bcc5-1b7568b4a497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 06 11:44:59.768286 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 6 11:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:44:59.778919 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:00.166600 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-2934345b-a0dc-42b4-b68e-0f2f1ffc411b admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:00.187556 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-2934345b-a0dc-42b4-b68e-0f2f1ffc411b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413245 Sep 06 11:45:00.188093 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 6 11:44:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:45:00.209578 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG dbcounter [-] [112071] Writing DB stats nova_api:SELECT=14 {{(pid=112071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:00.213500 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-7cf38c7c-509a-4d38-b717-4d583e0c8069 admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:00.221295 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-7cf38c7c-509a-4d38-b717-4d583e0c8069 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013313 Sep 06 11:45:00.221868 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Sep 6 11:45:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:45:00.234762 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-36346088-4c36-4876-95fb-04921e6fbd55 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:00.242425 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-36346088-4c36-4876-95fb-04921e6fbd55 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011310 Sep 06 11:45:00.242945 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Sep 6 11:45:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:45:00.257321 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:00.266692 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014809 Sep 06 11:45:00.267252 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Sep 6 11:45:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:45:00.279261 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-cef2b152-14ac-4377-b615-380a7bdcf2fe admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:45:00.287435 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-cef2b152-14ac-4377-b615-380a7bdcf2fe admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012010 Sep 06 11:45:00.287969 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Sep 6 11:45:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:48:01.575880 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:01.576943 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 06 11:48:01.577353 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:01.717147 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_api:SELECT=6 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:01.881908 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:01.885424 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:01.885929 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:01.886359 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:01.887075 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:01.887521 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:01.887936 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:01.922138 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-8cdf843c-8bd2-485e-b9d6-d9ae26f384a7 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.206321 Sep 06 11:48:01.922692 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 6 11:48:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:48:02.765129 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:02.766421 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Sep 06 11:48:02.766814 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:48:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:02.965894 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:02.969270 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:02.969758 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:02.970183 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:02.970958 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:02.971348 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:02.971757 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:02.991477 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-9317752a-f0c9-444a-90bd-2a86a77e44e0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080515 Sep 06 11:48:02.992059 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 6 11:48:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:48:14.284557 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:14.285563 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 06 11:48:14.286000 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:14.456159 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_cell0:SELECT=4 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.457261 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_cell1:SELECT=4 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.458058 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG dbcounter [-] [112070] Writing DB stats nova_api:SELECT=8 {{(pid=112070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:14.516664 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:14.520035 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:14.520501 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:14.520924 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:14.521627 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:14.522086 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:14.522492 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:14.550041 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-70ed46ec-a2d7-47ca-bfca-d6c7f3957ad2 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.098601 Sep 06 11:48:14.550600 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 6 11:48:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:48:15.398215 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: DEBUG nova.api.openstack.wsgi [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] Calling method '>' {{(pid=112071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:15.399882 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: INFO nova.api.openstack.requestlog [None req-e988cec0-97f3-469d-bcb5-562b754178fb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Sep 06 11:48:15.400287 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: [pid: 112071|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 6 11:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:48:15.608689 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG nova.api.openstack.wsgi [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Calling method '>' {{(pid=112070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:48:15.612061 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:15.612525 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:15.612943 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:15.613692 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:48:15.614135 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:48:15.614542 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: DEBUG oslo_concurrency.lockutils [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:48:15.636694 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: INFO nova.api.openstack.requestlog [None req-792c0b33-47f0-4dcd-b094-d83e3be77e8c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.089044 Sep 06 11:48:15.637260 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: [pid: 112070|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 6 11:48:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:49:14.029242 dv-cinder-856041-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 11:49:14.030041 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: Tue Sep 6 11:49:14 2022 - graceful shutdown triggered... Sep 06 11:49:14.030484 dv-cinder-856041-1-iscsi devstack@n-api.service[112071]: Gracefully killing worker 2 (pid: 112071)... Sep 06 11:49:14.030854 dv-cinder-856041-1-iscsi devstack@n-api.service[112070]: Gracefully killing worker 1 (pid: 112070)... Sep 06 11:49:15.031014 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: worker 1 buried after 1 seconds Sep 06 11:49:15.031584 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: worker 2 buried after 1 seconds Sep 06 11:49:15.031584 dv-cinder-856041-1-iscsi devstack@n-api.service[112056]: goodbye to uWSGI. Sep 06 11:49:15.032640 dv-cinder-856041-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 11:49:15.033203 dv-cinder-856041-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 11:49:15.036043 dv-cinder-856041-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 11:49:15.048648 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 11:49:15 2022] *** Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: nodename: dv-cinder-856041-1-iscsi Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: machine: x86_64 Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: clock source: unix Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: pcre jit disabled Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: detected number of CPU cores: 4 Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: current working directory: / Sep 06 11:49:15.050724 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: detected binary path: /usr/bin/uwsgi-core Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: your processes number limit is 47680 Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: your memory page size is 4096 bytes Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: detected max file descriptor number: 2048 Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: lock engine: pthread robust mutexes Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: thunder lock: enabled Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 11:49:15.051483 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 11:49:15.092639 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: Python main interpreter initialized at 0x55bb6065c9c0 Sep 06 11:49:15.092639 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: python threads support enabled Sep 06 11:49:15.092639 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: your server socket listen backlog is limited to 100 connections Sep 06 11:49:15.092639 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: your mercy for graceful operations on workers is 90 seconds Sep 06 11:49:15.093097 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 11:49:15.093097 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: *** Operational MODE: preforking *** Sep 06 11:49:15.093360 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: *** uWSGI is running in multiple interpreter mode *** Sep 06 11:49:15.093360 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: spawned uWSGI master process (pid: 127104) Sep 06 11:49:15.093541 dv-cinder-856041-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 11:49:15.094120 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: spawned uWSGI worker 1 (pid: 127121, cores: 1) Sep 06 11:49:15.095684 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: spawned uWSGI worker 2 (pid: 127122, cores: 1) Sep 06 11:49:15.095684 dv-cinder-856041-1-iscsi devstack@n-api.service[127104]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 11:49:15.762993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 11:49:15.778950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 11:49:16.956665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:49:16.956665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: from cryptography.utils import int_from_bytes Sep 06 11:49:16.957514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:49:16.957514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: from cryptography.utils import int_from_bytes Sep 06 11:49:16.970601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:49:16.970601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: from cryptography.utils import int_from_bytes Sep 06 11:49:16.971215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 11:49:16.971215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: from cryptography.utils import int_from_bytes Sep 06 11:49:19.393752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 11:49:19.394314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 11:49:19.394594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 11:49:19.394832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 11:49:19.395092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 11:49:19.395480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.395817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.396137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.396459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.396793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.397154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.397430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.397775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.398294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 11:49:19.398898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.399055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 11:49:19.399190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.399190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.399349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 11:49:19.399427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-1-iscsi {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.399499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 11:49:19.399574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.399645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 11:49:19.399919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.400893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.401072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.401238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.401393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.401577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.401756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.401909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.403452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.403708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.403970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.404186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.404418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.404642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.404865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.405083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.405333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856041-1-iscsi {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.405553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.405796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.406025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.406246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.406464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.406694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.406915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.407171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.407403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.407622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.408177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.408412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.408604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-1-iscsi {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.408833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.409025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.409185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.409347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.409531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.409738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.409890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.410995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.411544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.411700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.411857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.412009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.414269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.414561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.414816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.415079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.415253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.415416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.415580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856041-1-iscsi {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.418276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.418453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.418623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.418780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.418935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.419092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.419264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.419264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.419559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.419705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.421809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.421996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.422152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.422308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.422460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.422613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.422770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.422926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.423094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.423256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.423408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.423560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.423718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.423890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.424049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.424246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.424405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.424578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.424736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.424887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.427414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.427596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.427756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.427992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.428889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.429777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.430017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.430268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.430514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.430738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.430890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.431968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.432123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.432276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.432436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.432593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.432744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.432896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.433047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.433203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.433354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.433505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.433719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.433872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.434980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.435140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.435697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.436069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.436222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.436367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.436510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.436699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.436952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.437117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.437266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.437435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.437706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.437868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.438937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.439092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.439276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.439423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.439576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.439731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.439881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.440611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.440729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.440811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.440898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.440981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.440981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.441951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.442980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.443935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.444952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.445960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.446981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.447734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.447891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.447891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.448089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.448318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.448480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.448633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.448794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.448865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.448935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.449014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.449094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.449175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.449255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.449328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.449398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.449475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.449561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.449733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.449811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.449882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.449952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 11:49:19.450023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.450967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.451984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.452973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.453593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.455530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.455708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.455872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.456931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.457089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.457243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.457390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.457554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.457758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.457923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.458995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.459151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.459341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.459498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.459652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.459806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.459962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.460117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.460273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.460459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.460616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.460781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.460929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.461082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.461247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.461395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.461548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.461724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.461877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.462979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.463142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.463297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.463456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.463617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.463772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.463928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.464082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.464238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.464392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.464546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.464709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.464869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.465974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.466121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.466268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.466415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.466568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.466735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.466890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.467966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.468124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.468272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.468432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.468580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.468744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.468899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.469054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.469201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.469367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.469515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.469768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.469923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.470988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.471134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.471293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.471440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.471587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.471740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.471895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.472957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.473105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.473105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.473401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.473556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.473721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.473960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.474117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.474265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.474411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.474565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.474738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.474886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.475039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.475187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.475339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.475486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.475647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.475795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.476492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.476664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.476813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.476960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.477121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.477282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.477437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.477584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.477786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.477943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.478987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.479142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.479308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.479308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.479592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.479753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.479903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.480963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.481119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.481272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.481419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.481574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.481759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.481914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.482951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.483254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.483401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.483548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.483694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.483840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.483993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.484154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.484300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.484454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.484607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.484761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.484914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.485087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.485243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.485400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.485549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.485752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.485914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.486078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.486245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.486399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.486551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.486710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.486873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.487034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.487198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.487351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.487511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.487681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.487853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.488979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.489138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.489304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.489463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.489624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.489819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.489974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.490134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.490297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.490459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.490613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.490775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.490928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.491087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.491252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.491414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.491664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.491896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.492064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.492226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.492388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.492544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.492708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.492862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.493024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.493189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.493352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.493519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.493748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.493918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.494081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.494235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.494395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.494550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.494789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.494970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.495126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.495280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.495440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.495609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.495775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.495943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.496098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.496257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.496411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.496576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.496740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.496740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.497037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.497037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.497343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.497505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.497691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.497866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.498625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.499431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.499601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.499757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.499919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.500087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.500243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.500394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.500562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.500723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.500891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.501067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.501067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.501367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.501520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.501703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.501865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.502998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.503160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.503314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.503466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.503617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.503784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.503939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.504100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.504253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.504414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.504567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.504798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.504962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.505134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.505296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.505449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.505601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.506396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.506573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.506573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.506875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.506875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.507729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.507999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.508208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.508380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.508554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.508761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.508973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.509130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.509285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.509446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.509607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.510140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.510325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.510483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.510483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.510785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.510958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.511123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.511285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.511448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.511609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.511764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.511923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.512088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.512251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.512416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.512572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.512739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.512893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.513060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.513244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.513400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.513623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.513940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.514212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.514453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.514703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.514950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.515220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.515732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.516009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.516284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.516284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.516800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.517076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.517336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.517598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.517900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.518161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.518424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.518698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.518974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.519252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.519537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.519813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.520139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.520396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.520668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.520934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.521218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.521218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.521837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.522103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.522103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.522617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.523514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.523794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.524081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.524339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.524611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.524887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.525167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.525471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.525782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.526042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.526305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.526590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.526891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.527199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.527454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.527454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.527454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.527454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.528425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.528596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.528760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.528925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.529088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.529369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.529628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.529922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.530193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.530482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.530659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.530822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.530985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.531150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.531308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.531469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.531634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.531795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.531957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.532110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.532270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.532432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.532608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.532763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.532916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.533075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.533238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.533393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.533569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.533784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.533942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.534095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.534255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.534419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.534580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.534752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.534907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.535059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.535219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.535387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.535551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.535704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.535864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.536018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.536170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.536371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.536529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.536701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.536864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.537017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.537178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.537341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.537495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.537693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.537866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.538021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.538185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.538185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.538517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.538681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.538853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.539972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.540143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.540297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.540449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.540609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.540765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.540935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.541103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.541265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.541425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.541585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.541786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.541955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.542110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.542262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.542414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.542573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.542726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.542893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.543058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.543058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.543357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.543518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.543518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.543903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.544067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.544221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.544380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.544542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.544703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.544866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.545020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.545188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.545356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.545510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.545693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.545864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.546990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.547165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.547331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.547485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.547657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.547812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.547973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.548128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.548279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.548439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.548603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.548756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.548917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.549072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.549235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.549398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.549551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.549731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.549891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.550053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.550215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.550377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.550530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.550697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.550858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.551018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.551179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.551421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.551583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.551744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.551897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.552057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.552217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.552382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.552536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.552688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.552846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.553006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.553166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.553334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.553504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.553678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.553848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.554002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.554726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.554884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.555993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.556155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.556316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.556471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.556641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.556794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.556947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.557106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.557266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.557430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.557607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.557833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.557987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.558139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.558313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.558482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.558672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.558868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.559963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.560916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.561212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.561378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.561532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.561715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.561883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.562917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.563951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.564146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.564292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.564464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.564616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.564741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.564887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.565931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.566910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.567896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.568978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.569118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.569259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.569392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.569531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.569748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.570366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.570513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.570655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.570796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.570796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.571877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.572979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.573209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.573300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.573385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.573624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.573803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.573941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.574891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.575996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.576956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.577223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.577364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.577509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.577700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.577836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.577988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.578944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.579917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.580999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.581997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.582968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.583972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.584934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.585980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.586976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.587938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.588906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.589914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.590899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.591973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.592944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.593898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.594970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.595912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.596973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.597971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.598988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.599930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.600178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.600322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.600456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.600598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.600733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.600872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.601998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.602266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.602403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.602536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.602676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.602825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.602960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.603924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.604176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.604319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.604454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.604587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.604720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.604861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.605885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.606974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.607918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.608874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.609979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.610864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.611930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.612903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.613938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.614948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.615946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.616208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.616339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.616461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.617118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.617298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.617496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.617712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.617879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.618946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.619919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.620854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.621986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.622931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.623877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.624908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.625900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.626985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.627943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.628092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.628226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.628358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.628490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.628813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.628957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.629107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.629232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.629385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.629500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.629693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.629693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.630913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.631971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.632106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.632302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.632986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.633133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.633276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.633394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.633510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.633768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.633920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.634871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.635880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.636936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.637936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.638963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.639921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.640053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.640182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.640327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.640713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.640847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.640963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.641934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.642892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.643901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.644997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.645149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.645284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.645424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.645565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.645793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.645927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.646918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.647059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.647194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.647331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.647464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.647596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.647732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.648368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.648496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.648611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.648733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.648859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.648990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.649935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.650993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.651134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.651268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.651401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.651543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.651685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.651846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.652898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.653887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.654867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.655997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.656959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.657970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.658943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.659897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.660877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.661986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.662537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.663431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.663431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.663431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.664347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.664482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.665090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.665421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.665774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.666091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 11:49:19.666335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 11:49:19.722524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO dbcounter [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Registered counter for database nova_api Sep 06 11:49:19.729199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO dbcounter [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Registered counter for database nova_api Sep 06 11:49:19.743473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_db.sqlalchemy.engines [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:19.749127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:19.750246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writer thread running {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:19.755799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writer thread running {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:19.808959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.context [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5389d5db-2fbe-430b-a0d6-b470d1cc30cf(cell1) {{(pid=127122) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 11:49:19.813213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:19.813529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:19.815153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:19.815470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.context [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5389d5db-2fbe-430b-a0d6-b470d1cc30cf(cell1) {{(pid=127121) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 11:49:19.815997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:19.816445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:19.818510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:19.821097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:19.821392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO dbcounter [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Registered counter for database nova_cell0 Sep 06 11:49:19.821749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:19.823893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:19.824583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:49:19.825122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:49:19.825601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO dbcounter [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Registered counter for database nova_cell1 Sep 06 11:49:19.827620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:49:19.834239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO dbcounter [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Registered counter for database nova_cell0 Sep 06 11:49:19.834449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_db.sqlalchemy.engines [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:19.834991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO dbcounter [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Registered counter for database nova_cell1 Sep 06 11:49:19.837414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_db.sqlalchemy.engines [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:19.841876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writer thread running {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:19.845361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:19.846167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:19.854061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writer thread running {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:19.854411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writer thread running {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:19.992206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writer thread running {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:20.001711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO dbcounter [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Registered counter for database nova_cell0 Sep 06 11:49:20.003275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO dbcounter [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Registered counter for database nova_cell0 Sep 06 11:49:20.010228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_db.sqlalchemy.engines [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:20.011715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 11:49:20.015190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writer thread running {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:20.016527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writer thread running {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 11:49:20.339899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: WARNING keystonemiddleware.auth_token [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:49:20.345873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: WARNING keystonemiddleware.auth_token [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:49:20.347351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: WARNING keystonemiddleware.auth_token [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:49:20.353908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: WARNING keystonemiddleware.auth_token [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:49:20.700982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: WARNING keystonemiddleware.auth_token [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:49:20.706793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: WARNING keystonemiddleware.auth_token [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 11:49:20.707697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: WARNING keystonemiddleware.auth_token [None req-c5ef035b-3e6d-4491-8bfc-2373423c76e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:49:20.712971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: WARNING keystonemiddleware.auth_token [None req-a157f12c-e5ec-4e88-b7cf-c35e89a49353 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 11:49:20.713198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb6065c9c0 pid: 127121 (default app) Sep 06 11:49:20.718390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb6065c9c0 pid: 127122 (default app) Sep 06 11:50:07.467170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:07.469049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:07.470630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:07.471815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:09.008697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de619e70-2aa1-41e1-b1c3-05cb6a61d605 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'create', calling method: .version_select at 0x7f97f5e2b280>, body: {"keypair": {"name": "tempest-keypair-399595887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL88NrAUwgKEiQmkTgfJcSQn+DhiOgv7h+493/XmyaKruxIB8Nx8JoyALfpKRjdpy+2rjFrs70o9mXN3bEzvzGHwEMtYxCoZOzcDVkkkl4dJ1WFZV6DZrwzkIQ2c6x/AKw=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:09.177163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-de619e70-2aa1-41e1-b1c3-05cb6a61d605 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for project a896d72b5b00477d855131345711c748. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:09.214836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-de619e70-2aa1-41e1-b1c3-05cb6a61d605 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for user e235718ad1da42ebb209fb4b13626ff1 and project a896d72b5b00477d855131345711c748. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:09.341795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de619e70-2aa1-41e1-b1c3-05cb6a61d605 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.880748 Sep 06 11:50:09.343861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1/1] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Sep 6 11:50:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1887 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 11:50:17.876953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:17.877970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:17.879251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:17.880120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:18.765377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c61c4b0-1007-4fb1-92d5-ec40492bf63c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: .version_select at 0x7f97f5cfe430>, body: {"keypair": {"name": "tempest-keypair-1055909117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtOuPE8hjsy+E9lFStxl2OZYGDF7H61QAvZ+V2r4QzXZGoLJF0JD8IVUTYjv3YsB59cI1ZH96vHRiLnQRZholei8NOU6dO+aF/0J4Z5eHFtTAHpSRaHSxmXgWWQp7Px0w=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:18.856970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-8c61c4b0-1007-4fb1-92d5-ec40492bf63c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:18.891294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-8c61c4b0-1007-4fb1-92d5-ec40492bf63c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:19.032452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c61c4b0-1007-4fb1-92d5-ec40492bf63c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.748189 Sep 06 11:50:19.053002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 11:50:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:19.089520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1247505494", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d9784aa-9738-4bb2-80bc-2db45f4fdf93"}], "security_groups": [{"name": "tempest-securitygroup--551854253"}], "key_name": "tempest-keypair-399595887", "user_data": "}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:20.533072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f834ff02-8c34-4ff5-a006-97ff14f5fb75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: .version_select at 0x7f97f5e2b280>, body: {"keypair": {"name": "tempest-keypair-1299797793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCtWjorivsavcqBQtXB79Pd9g7BJUNFPaHP2mE1hOiiuNFXXVQ/wrgJxBLGA1SubtnDZjU1UxMYZh7f3IpcwHFKxFVVq3lq0pSgtDuy3UWupiKPPUM7YxVOALJH7wQRVw=="}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:20.602945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-f834ff02-8c34-4ff5-a006-97ff14f5fb75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for project 2be7be1a9bb1487aac2c32871398119e. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:20.616268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-f834ff02-8c34-4ff5-a006-97ff14f5fb75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for user ccbb0b2070694235bf87a7b9a0c84dbe and project 2be7be1a9bb1487aac2c32871398119e. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:20.735831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f834ff02-8c34-4ff5-a006-97ff14f5fb75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 2.864241 Sep 06 11:50:20.736466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 11:50:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:20.863964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] validate_networks() for [('2d9784aa-9738-4bb2-80bc-2db45f4fdf93', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:21.462886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1926529", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "networks": [{"uuid": "19b47e6c-6e31-4980-8003-20e49d696e86"}]}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:23.138858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] validate_networks() for [('19b47e6c-6e31-4980-8003-20e49d696e86', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:23.943815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:23.944393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:23.945045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:23.945720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:23.946373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:23.979361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:23.979989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:23.980871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:23.981819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:23.983364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:23.984025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:24.043662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for project a896d72b5b00477d855131345711c748. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:24.066262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for user e235718ad1da42ebb209fb4b13626ff1 and project a896d72b5b00477d855131345711c748. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:24.082456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:24.091113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:24.231396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cf9a3d97-bf03-4c6d-8855-1385ea76d41f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.172572 Sep 06 11:50:24.232483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 3/4] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Sep 6 11:50:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 5179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 11:50:24.898729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2132799284", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:25.009629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] validate_networks() for [('494bff09-0910-4e09-b2f9-dce2571e584d', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:25.763657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:25.764096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:25.765282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:25.765969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:25.766557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:25.781694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:25.782576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:25.783295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:25.784669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:25.785512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:25.786552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:25.814283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for project ef6b481491244111a479eb91e3594ae4. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:25.820597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for user 41bc35497fe94ababe0c824a429168d3 and project ef6b481491244111a479eb91e3594ae4. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:25.853367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:25.859990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:26.004997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aea88b69-f530-4346-8e7b-6cfb318bc274 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.770987 Sep 06 11:50:26.005744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 4/5] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:50:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:50:26.029621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1377822180", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cda860d2-2fe0-49d5-8510-1c9e43ecbe57"}], "security_groups": [{"name": "tempest-securitygroup--279362159"}], "key_name": "tempest-keypair-1055909117", "user_data": "}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:26.345462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] validate_networks() for [('cda860d2-2fe0-49d5-8510-1c9e43ecbe57', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:26.906056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:26.906550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:26.906934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:26.907867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:26.908598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:26.934517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:26.935893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:26.939057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:26.940069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:26.945285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:26.946145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:27.041821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Getting quotas for project df65a60541a8492a912cab1a8f243253. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:27.060994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Getting quotas for user 8dd2f6cc960242e2b01df2caf0aba2cd and project df65a60541a8492a912cab1a8f243253. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:27.103087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:27.108953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:27.304899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-96abb1fc-e1c5-43ff-bc59-48e860efeb65 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.561166 Sep 06 11:50:27.311157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2/6] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 6574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:50:27.328707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:27.329358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:27.376998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:27.392100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:27.394644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:27.399216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:27.402255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:27.402957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:28.103242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:28.130164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:28.132933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:28.134640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c68e14d-3d5d-4837-8e1f-77e7562ab40e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1277 microversion: 2.20 time: 0.822240 Sep 06 11:50:28.136377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 3/7] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1277 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:28.155047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-630264374", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1984278-bf78-4be1-a7c3-c6735a1ccdd2"}], "security_groups": [{"name": "tempest-securitygroup--2021335083"}], "key_name": "tempest-keypair-1299797793", "user_data": "}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:28.203287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:28.203869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:28.204948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:28.204948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:28.204948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:28.229143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:28.230387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:28.232531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:28.235615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:28.258297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:28.259373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:28.345786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:28.402501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:28.424396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:28.428756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:28.534734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] validate_networks() for [('c1984278-bf78-4be1-a7c3-c6735a1ccdd2', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:28.574034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e75e6107-8fe1-4e3a-ae12-d8f17f9e9c3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.563063 Sep 06 11:50:28.578228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 5/8] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:50:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:50:28.613311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:28.614440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:28.704578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:28.705079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:28.705532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:28.706265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:28.706723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:28.707158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.469085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:29.499318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d1344011-b278-470e-8c0d-c43051f4e633 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1226 microversion: 2.1 time: 0.917023 Sep 06 11:50:29.515892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 6/9] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:28 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1226 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:29.544846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:29.556873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:29.568808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.569528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.584034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.590180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.601607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.603168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.777321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:29.777976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:29.778253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:29.778665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:29.779259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:29.812366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.813114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.814080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.815145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:29.815906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:29.816548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:29.847679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:29.856950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for project 2be7be1a9bb1487aac2c32871398119e. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:29.863856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b86a8e74-e50f-4a83-9c48-09cd1e300d7d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.324067 Sep 06 11:50:29.865945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:29 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:29.868731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for user ccbb0b2070694235bf87a7b9a0c84dbe and project 2be7be1a9bb1487aac2c32871398119e. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:29.889390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c3fca4b0-0a91-4ccf-bbc8-f102339c8557 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:29.895425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c3fca4b0-0a91-4ccf-bbc8-f102339c8557 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:29.900379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:29.906426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:30.065312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f42b8b2-0dc4-44fc-8c51-89d014f7cee8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.927606 Sep 06 11:50:30.066013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 4/11] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:50:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:50:30.080803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:30.088676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:30.140717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:30.142751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:30.146430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:30.148275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:30.153374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:30.154256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:30.265969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c3fca4b0-0a91-4ccf-bbc8-f102339c8557 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:30.341989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c3fca4b0-0a91-4ccf-bbc8-f102339c8557 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1242 microversion: 2.1 time: 0.468491 Sep 06 11:50:30.346571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1242 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:30.382759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1725450003", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:30.441077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:30.455884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:30.459498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:30.476143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1039bcd6-1e5a-42aa-a9f7-3c3ea519b602 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1339 microversion: 2.20 time: 0.399127 Sep 06 11:50:30.487725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 5/13] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1339 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:30.503568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5d1984b3-1668-4f46-8d05-020be6ef5d34 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:30.504532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5d1984b3-1668-4f46-8d05-020be6ef5d34 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:30.690850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5d1984b3-1668-4f46-8d05-020be6ef5d34 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:30.727642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5d1984b3-1668-4f46-8d05-020be6ef5d34 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1237 microversion: 2.1 time: 0.238688 Sep 06 11:50:30.752254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 6/14] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1237 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:30.892988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:30.893604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:30.927701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:30.928627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:30.931132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:30.932383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:30.933129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:30.934989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.184866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:31.198545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-df8b0e12-f377-47ae-90ba-677cd665df50 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.308323 Sep 06 11:50:31.199747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 7/15] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:30 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:31.374042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:31.374998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:31.390165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.396825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.398376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.400374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.406366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.407073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.591583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:31.601308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f0bbaa4e-efb2-46e4-beb0-9cfaacd9f53c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.231355 Sep 06 11:50:31.610573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:31.626305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:31.629167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:31.642905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.643237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.649187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.650248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:31.650958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:31.651607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:31.947146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:31.957969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:31.960411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:31.961904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8143596e-5d86-43ba-9498-c15915929305 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.350141 Sep 06 11:50:31.962767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 9/17] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:31.968625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:31.969617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:32.002070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.002960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.003949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.006934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.007542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.008191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.159020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:32.176081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfecf5a9-3d0f-4d18-847e-9f85dee266de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.212064 Sep 06 11:50:32.190456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 10/18] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:32.223562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:32.225096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:32.247042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.247519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.248009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.248696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.249141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.249810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.419163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:32.433942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b999ffa3-fbac-4aa7-bd5b-8c8353e99355 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.211462 Sep 06 11:50:32.434959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 11/19] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:32 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:32.635709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:32.636693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:32.644459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.645370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.646699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.647593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:32.648116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:32.648642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:32.754899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:32.769670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b52e1f10-7154-462b-ab23-49dd3b3d4865 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.138271 Sep 06 11:50:32.781424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 12/20] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:32.992168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:32.992952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:33.000189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.000726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.001197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.025080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.025629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.026102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.222898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.239621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.246893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.248633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36062391-af07-4733-adee-3cbc6b257cc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.260759 Sep 06 11:50:33.253055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 13/21] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:33.263750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:33.267184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:33.285973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.287463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.288425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.289352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.289854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.290296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.357519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.366972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9257bdb-25e1-43ab-86f8-dfca3623a608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.112332 Sep 06 11:50:33.368377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 14/22] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:33.460924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:33.461899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:33.470490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.471656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.472194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.473830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.474873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.475374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.549189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.559104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ad4cae16-6c15-4d69-a3dc-175b33796e17 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.102014 Sep 06 11:50:33.560703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 15/23] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:33 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:33.793673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:33.794345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:33.800707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.801281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.801860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.803280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:33.803883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:33.804434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:33.871044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:33.880713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f0b4a8e-544a-4363-ab86-3a42f3fad584 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.090891 Sep 06 11:50:33.881497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 16/24] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:34.281426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:34.282149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:34.289329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.290036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.290479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.291193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.291652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.292079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.439597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:34.448059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:34.449515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:34.450671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-01b6569e-7e57-4c69-9698-119226401578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.173200 Sep 06 11:50:34.451235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 17/25] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:34.455883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:34.456492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:34.463111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.463599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.464064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.464758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.465204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.465624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.532712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:34.541579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e2e69fcd-cecb-4320-ba4a-dbda8b26928c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.089296 Sep 06 11:50:34.542190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 18/26] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:34.586306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:34.586925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:34.593028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.593526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.593989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.594691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.595145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.595565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.661139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:34.670656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-686a2538-d0aa-49f7-9341-54bde893930f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.088903 Sep 06 11:50:34.671641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 19/27] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:34 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:34.904447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:34.905071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:34.911166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.913159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.913807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.914514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:34.915122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:34.915549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:34.985685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:34.989306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:34.995100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-afc9d5db-1487-4231-bdea-d359cd9a52de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.094416 Sep 06 11:50:34.998309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 20/28] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:35.477312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:35.478071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:35.484066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:35.484546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:35.484977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:35.485685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:35.486135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:35.486558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:35.619703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:35.627800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:35.629288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:35.630602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d57acd33-b651-4027-aae8-efcb88d34cb4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.158996 Sep 06 11:50:35.631309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 21/29] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:35.635744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:35.636346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:35.642514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:35.642993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:35.643423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:35.644109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:35.644585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:35.644970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:35.707498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:35.716196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f537ea9-8bb1-4858-8815-f005b0d7e3a9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.083863 Sep 06 11:50:35.716955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 22/30] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:35.721831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:35.722701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:35.730122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:35.730991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:35.731245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:35.732115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:35.732759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:35.733000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:35.799444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:35.807726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f45ea5b-d156-42f5-a680-6aefd081fd8e tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.089530 Sep 06 11:50:35.808305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 23/31] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:35 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:36.023998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:36.024528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:36.030573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.031081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.031507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.032203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.032678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.033106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.104226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:36.112259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58371797-de04-40f3-8c91-10aca233dbf3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.093171 Sep 06 11:50:36.113124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 24/32] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:36.657622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:36.659292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:36.667208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.667793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.668327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.669095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.669670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.670182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.808716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:36.823159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:36.824663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:36.825859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-00b858fe-186b-453e-9689-5aafc715c927 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.172654 Sep 06 11:50:36.833675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 25/33] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:36.833675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:36.833675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:36.840043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.840427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.840864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.841598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.842094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.842520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.908040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:36.916956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c3c4ebe-b266-4ab2-ac9b-f7066ae2c444 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.089186 Sep 06 11:50:36.917788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 26/34] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:36.926785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:36.927487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:36.934273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.934759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.935198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.935896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:36.936417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:36.936798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:36.999508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:37.007755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-10202935-7503-4650-9b0c-4b765afc8fea tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.084827 Sep 06 11:50:37.008327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 27/35] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:36 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:37.136843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:37.137459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:37.143715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:37.144199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:37.144636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:37.145323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:37.145809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:37.146237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:37.209997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:37.217573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-28893382-b80d-4aa7-993a-b4de77f18a67 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.084507 Sep 06 11:50:37.218172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 28/36] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:37.854120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:37.855413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:37.859168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:37.863639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:37.864676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:37.864826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:37.865942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:37.866598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:37.867039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.015050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.036491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.038044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.039200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-533337a7-effd-47e3-aa5b-48827e72fc00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.190667 Sep 06 11:50:38.040128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 29/37] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:38.045280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:38.045929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:38.052385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.053155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.053594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.054419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.054892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.055331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.119051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.126770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c68fb3ec-cc70-4bda-a185-49edb4d8b982 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.085594 Sep 06 11:50:38.127339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 30/38] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:38.133082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:38.133721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:38.140320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.141050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.141474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.142202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.142637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.143051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.208312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.216572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-93dcc011-c98a-49ff-95d8-a0767f481f81 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.088196 Sep 06 11:50:38.217147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 31/39] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:38 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:38.240498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:38.241212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:38.247066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.247557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.247992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.248682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:38.249139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:38.249556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:38.294844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=6 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:38.314334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:38.322641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b058acb-f103-4e57-a9df-04ff5ceb1929 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.085876 Sep 06 11:50:38.323185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 32/40] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:39.069167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:39.069802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:39.075761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.076240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.076671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.077363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.077851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.078273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.213439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.222701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.224160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.226336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b237c0db-6b49-4cb1-9bca-36b4980ca63f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161404 Sep 06 11:50:39.226900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 33/41] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:39.231349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:39.231956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:39.241069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.241069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.241069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.241069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.241333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.241333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.304593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.315973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-174facdf-8a5d-4efe-8e11-dbfffe52a769 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.087849 Sep 06 11:50:39.317431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 34/42] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:39.324057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:39.324912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:39.332442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.333025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.333614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.335140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.335611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.336038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.400707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.409613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9fc21ab6-d5a0-42ea-9811-b21321fa9ab8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.090884 Sep 06 11:50:39.418641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 35/43] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:39 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:39.418641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:39.418641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:39.424788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.425726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.426443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.427647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:39.428115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:39.428643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:39.508886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:39.518998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-64b9332c-cdf4-498f-a9f3-6e995fd3e92b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.107595 Sep 06 11:50:39.519844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 36/44] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:39.855779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=18 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.253709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:40.254969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:40.256617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.271658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.272766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.273216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.273972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.274440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.274867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.279817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.312507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.425522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=11 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.467766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.477264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.478722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.479879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-710ed1e1-1362-44cb-b638-83a4f0e8377d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.230431 Sep 06 11:50:40.507128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 37/45] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:40.520883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:40.526088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:40.536923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.544631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.545191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.546109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.546541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.546943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.654286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.684138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfaaa309-3efa-4f51-9616-61ec9c32499c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.174735 Sep 06 11:50:40.684868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 38/46] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:40.689479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:40.698433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:40.707216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.707713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.708153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.709385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.709884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.710303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.726986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=18 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:40.795391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.824412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1ffeca26-5b1e-4e69-a6b5-326381cd3af1 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.138575 Sep 06 11:50:40.826702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 39/47] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:40 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:40.831300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:40.831934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:40.869508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.874647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.875093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.875833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:40.876285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:40.876708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:40.951903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:40.960750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e5d72534-43f0-41e1-b6e6-2e6d9f87c78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.133073 Sep 06 11:50:40.961530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 40/48] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:41.484793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] validate_networks() for [('494bff09-0910-4e09-b2f9-dce2571e584d', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:50:41.505474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:41.506404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:41.514477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.515787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.516332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.517038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.517495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.517944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.682810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:41.691001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:41.692437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:41.694204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-25f94644-dbfb-4e5e-a885-373e084660a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.192614 Sep 06 11:50:41.694930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 41/49] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:41.714905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:41.715590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:41.721586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.722172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.722693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.723446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.723967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.724511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.815699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:41.825250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7b6adc70-aec1-46e1-8265-50f8864966bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.117749 Sep 06 11:50:41.826611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 42/50] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:41.848835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:41.850152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:41.858443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.859104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.859753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.860461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.861415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.861539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.937818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:41.948224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-48d2c6eb-9860-4130-934f-838fe8957bda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.104772 Sep 06 11:50:41.949817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 43/51] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:41 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:41.988237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:41.988856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:41.995179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:50:41.995606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:50:41.996658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:50:41.996834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.997188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:50:41.997301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.997707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:50:41.997814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:41.998554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:41.999108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:41.999570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.013662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.014179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.014620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.016297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.016923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.017361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.043598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for project ef6b481491244111a479eb91e3594ae4. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:50:42.047552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for user 41bc35497fe94ababe0c824a429168d3 and project ef6b481491244111a479eb91e3594ae4. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:50:42.059074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:50:42.061238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:50:42.063744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:42.072896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d67b1ce7-7b6c-4b3d-a679-f9a809d6d6ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.089991 Sep 06 11:50:42.073761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 44/52] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:42.106935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e26e787-87c8-4048-8c75-78e8e761871b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 11.754644 Sep 06 11:50:42.108172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 9/53] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:50:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 11756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:50:42.120424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21e876ba-0869-43d1-959f-d00fcd169ee6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:42.121392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21e876ba-0869-43d1-959f-d00fcd169ee6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:42.187978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-21e876ba-0869-43d1-959f-d00fcd169ee6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:42.196557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21e876ba-0869-43d1-959f-d00fcd169ee6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1222 microversion: 2.1 time: 0.079914 Sep 06 11:50:42.197483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 45/54] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:42 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:42.733191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:42.734404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:42.740840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.741454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.742045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.742754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.743229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.743664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.855667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:42.856935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:42.863285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.863852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.864527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.865988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.866759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.867524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.942475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:42.953278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-26afc010-574c-45a6-8c9f-193b61fbb24e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1241 microversion: 2.1 time: 0.108418 Sep 06 11:50:42.954605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 46/55] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:42.978335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:42.979095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:42.988873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.989560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.990802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:42.991852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:42.992317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:42.992758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.002945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.045819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.047325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.048485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7998ee16-47ca-4591-ad35-ac44e3081aee tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.320916 Sep 06 11:50:43.060439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 10/56] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:43.103781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:43.104686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:43.114309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.118201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:43.119130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.121219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.121712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:43.123056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.359603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.389808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a09d7e64-8d7e-429a-8e4f-7c84065e581d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1264 microversion: 2.1 time: 0.419225 Sep 06 11:50:43.428146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 47/57] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:42 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1264 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:43.441485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:43.444772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:43.464702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.465880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:43.467101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.468731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.469922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:43.470893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:43.520485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.536580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8e044de0-e997-4a48-9b5c-262aaefc0643 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1294 microversion: 2.1 time: 0.442998 Sep 06 11:50:43.538361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 11/58] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1294 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:43.588630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:43.597134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3951d47a-883c-4204-8ac9-ab4d47d04c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1218 microversion: 2.1 time: 0.165934 Sep 06 11:50:43.597746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 48/59] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:43 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:43.978062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:43.979304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:43.991413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:43.993024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.001983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.003126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.003770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.004389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.081787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:44.082952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:44.096003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.096828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.097430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.098415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.104496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.105109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.190882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:44.200764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c35ea090-c793-4a5d-ac77-b0d76b490758 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1233 microversion: 2.1 time: 0.228066 Sep 06 11:50:44.201516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 12/60] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1233 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:44.438307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:44.439268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:44.463832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.464350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.464799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.471684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.472390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.472871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.828735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:44.843089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:44.845939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:44.847829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-183e5ea0-2066-4425-800d-68d61e8e7c1d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.770495 Sep 06 11:50:44.860863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 49/61] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:44.884637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:44.885731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:44.888262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:44.900389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.900580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5f8597ab-d924-438e-8e6a-d794a11fd64f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1270 microversion: 2.1 time: 0.466097 Sep 06 11:50:44.900929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.901422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.902182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.902361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 13/62] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:44 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1270 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:44.903926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.904669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.908392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:44.909272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:44.928859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.932796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.933255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:44.934638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:44.935101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:44.937466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.046950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:45.059585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32041d96-09fd-4b7f-9f4c-3dd99fff000b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1274 microversion: 2.1 time: 0.155351 Sep 06 11:50:45.060624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 14/63] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:44 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:45.230159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:45.230781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:45.243902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:45.249561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.251324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.251787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.252568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.253046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.253585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.254033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29eb908b-5083-4dc1-ba22-3ab155a8bc4c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1300 microversion: 2.1 time: 0.391642 Sep 06 11:50:45.255091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 50/64] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1300 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:45.454523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:45.467315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bbfc6434-5332-40ee-afbb-275af3417aad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1289 microversion: 2.1 time: 0.241249 Sep 06 11:50:45.468553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 15/65] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1289 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:45.887976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:45.890818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:45.932128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.933508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.933996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.936983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:45.937236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.938055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:45.938700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.942539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.962793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.964997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.965886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:45.969933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:45.970588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:45.973763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:46.713917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:46.723574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-80214c57-c9a3-4fde-9344-9fa5b1b06283 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.797587 Sep 06 11:50:46.725306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 16/66] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:45 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:46.731528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:46.738058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:46.745868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:46.746620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:46.747293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:46.749305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:46.749990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:46.750641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:46.889477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:46.903959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:46.909177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:46.910383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-707f3b7b-5392-4139-9935-0ec757aa73d7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 1.038547 Sep 06 11:50:46.910974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 51/67] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:46.954778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:46.955394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:46.969434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:46.971947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:46.975001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:46.976349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:46.977041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:46.978226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.107963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:47.116198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cf30d43d-e651-41fa-ae3b-9d59ac16362e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1280 microversion: 2.1 time: 0.389236 Sep 06 11:50:47.126416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 17/68] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:46 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:47.140692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:47.142130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:47.142901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:47.157153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.157914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.158382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7315f57e-96b5-4cc7-9346-68dd2d8b4de2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1300 microversion: 2.1 time: 0.243538 Sep 06 11:50:47.158689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.159543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.160145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.160540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 52/69] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:47.160886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.522815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:47.541826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.542316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.542799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.557389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:47.566079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Creating event network-changed:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 11:50:47.566621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 11:50:47.567005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-00cc8c1d-1055-4a10-ae73-f6f86bf2ea0a req-662f9de3-2952-4bcd-a3e1-3169c21b9ca2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 11:50:47.568808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.569275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.569755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.570645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.571293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.571860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.574315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00db14d6-2cd1-4d14-996a-fa47e8c70f83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1295 microversion: 2.1 time: 0.444324 Sep 06 11:50:47.575751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 18/70] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1295 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:47.582258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.compute.rpcapi [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 11:50:47.583220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] Releasing lock "compute-rpcapi-router" {{(pid=127122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 11:50:47.620471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8249537-4ccc-4e73-97be-b45f4bfb19d0 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341666 Sep 06 11:50:47.622431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 53/71] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:47.748783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:47.749427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:47.763585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.764361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.764976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.765972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.766436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.766862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.964856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:47.966298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:47.976536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.977030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.977454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:47.980372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:47.981039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:47.981675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.256403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:48.272501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32162e5c-7c6f-49e4-908e-5cda0cd016fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.527677 Sep 06 11:50:48.273684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 19/72] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:47 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:48.291212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:48.293966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:48.309702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:48.314102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:48.315445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.317899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:48.318697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:48.319330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.483959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:48.546105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:48.548168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:48.550659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a8545a11-8e91-42d8-8d5f-6861d4cf0ba2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.611547 Sep 06 11:50:48.551746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 54/73] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:48.559743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:48.560578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:48.568900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:48.569798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:48.570376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.572085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:48.572710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:48.573562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.629413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:48.887720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:48.906894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0e2c13c-a310-4cce-8db9-ea4f4a3b4d58 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.630422 Sep 06 11:50:48.908155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 20/74] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:48 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:48.941615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:48.942595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:48.951683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:48.952564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:48.953238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:48.954260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:48.954931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:48.955577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.402103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:49.415035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-82534381-5680-4ff8-a57e-c3c32535e4db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.861207 Sep 06 11:50:49.416110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 55/75] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:49.423578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:49.425294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:49.434220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.434914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.435488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.436453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.437389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.438054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.557592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:49.569933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35462633-0fb5-4770-8319-cfbcfc675a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.660219 Sep 06 11:50:49.589459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 21/76] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:49.599968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:49.601394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:49.609500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.610293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.610983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.612384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.613074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.613884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.889460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:49.910218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:49.916773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:49.919748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9a652cc-b34d-4ae3-a8ed-7bbcaf2e0e1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.328763 Sep 06 11:50:49.920335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 22/77] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:49.940110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e0412c-b404-44d6-8460-ba2be7a0ccdb", "tag": "94bc6936-1b5d-4a19-89d7-83fb58d05514"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:49.955715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.956408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.956980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.978937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Creating event network-changed:94bc6936-1b5d-4a19-89d7-83fb58d05514 for instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb on hv-cinder-85604 Sep 06 11:50:49.979720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 11:50:49.980553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a5a2e14b-019d-4ab8-a6aa-f2f09073b92c req-a48d5321-bbf3-4378-b725-e2354a0052cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=127121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 11:50:49.981946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.982683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.983422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:49.984310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:49.984866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:49.985683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.000767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.compute.rpcapi [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 11:50:50.001927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] Releasing lock "compute-rpcapi-router" {{(pid=127121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 11:50:50.020028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6b090329-a5dd-43c9-85b3-afc122c8988f None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098482 Sep 06 11:50:50.022238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 23/78] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:50.029362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:50.030413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:50.039246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.039943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.040533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.041496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.042200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.042798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.066846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:50.080118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf70c073-653f-4ee2-915f-093bce8ad04c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.661263 Sep 06 11:50:50.081303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 56/79] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:49 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:50.283688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:50.292963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f89d754f-7824-40a7-b859-0d2244a18fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.269251 Sep 06 11:50:50.293790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 24/80] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:50 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:50.454015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:50.455834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:50.467096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.467668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.468603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.469498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.470147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.470999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.596679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:50.597557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:50.606081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.607445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.609878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.611306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.612141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.612740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.831418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:50.841671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31c75fc0-07eb-4977-9a42-5ed7df641454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.248924 Sep 06 11:50:50.850528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 25/81] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:50.923225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:50.941451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4df73850-b750-4349-8f62-17cb7a731eba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.492823 Sep 06 11:50:50.948695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:50.949318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:50.958133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.958781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.959322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.959914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:50.960361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:50.960778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:50.963850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 57/82] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:51.004814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:51.106444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:51.107174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:51.114041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.115383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.116022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.117142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.117871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.118490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.144983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:51.155582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:51.157491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:51.159154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0bcb6d1a-2caf-427f-9a0e-9d7a82dfed51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.214512 Sep 06 11:50:51.159974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 26/83] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:50:51.320195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:51.321035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:51.329181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.329946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.331030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.331803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.332260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.332807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.559114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:51.574595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0be2c6b0-2bbf-4c34-84fa-014c36941cd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.471930 Sep 06 11:50:51.585903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:51.586253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 58/84] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:51 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:51.600922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b7467d60-bb98-4e92-b7c3-58b41d8c6a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.287352 Sep 06 11:50:51.603253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 27/85] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:51 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:51.688540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-b40f3738-711b-439e-91ef-9337d557ec64 req-44fbc0a3-d1b4-4b26-8097-e8f4a84378d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d49777e-ab48-453f-8bef-9b496e07fb75", "tag": "1754716f-7e60-43f8-8750-dac04f227184"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:51.703337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-b40f3738-711b-439e-91ef-9337d557ec64 req-44fbc0a3-d1b4-4b26-8097-e8f4a84378d8 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.704120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-b40f3738-711b-439e-91ef-9337d557ec64 req-44fbc0a3-d1b4-4b26-8097-e8f4a84378d8 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.704620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-b40f3738-711b-439e-91ef-9337d557ec64 req-44fbc0a3-d1b4-4b26-8097-e8f4a84378d8 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.717396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-b40f3738-711b-439e-91ef-9337d557ec64 req-44fbc0a3-d1b4-4b26-8097-e8f4a84378d8 service nova] Creating event network-changed:1754716f-7e60-43f8-8750-dac04f227184 for instance 8d49777e-ab48-453f-8bef-9b496e07fb75 on hv-cinder-85604 Sep 06 11:50:51.723654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-b40f3738-711b-439e-91ef-9337d557ec64 req-44fbc0a3-d1b4-4b26-8097-e8f4a84378d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135798 Sep 06 11:50:51.725091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 59/86] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:51.868538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:51.868964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:51.880117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.881181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.881623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.887603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:51.888457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:51.889082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:51.992390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:51.993417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:52.001793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.002697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.004121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.005375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.006966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.007607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.054725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=6 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:52.192423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:52.632219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:52.644032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f5517356-23c6-46a5-b180-3e1c1214d7f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.782928 Sep 06 11:50:52.645261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 28/87] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:52.658346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-27419ccf-2d46-46a0-96cf-49f7f27be81b req-643f2d81-7f4c-4dc8-9750-675fb78c06de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2942181c-63de-4194-946d-9d8ca5c4b4a3", "tag": "429d5db2-cf15-4c0a-adeb-c7310ca25fc9"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:52.669554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-27419ccf-2d46-46a0-96cf-49f7f27be81b req-643f2d81-7f4c-4dc8-9750-675fb78c06de service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.670339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-27419ccf-2d46-46a0-96cf-49f7f27be81b req-643f2d81-7f4c-4dc8-9750-675fb78c06de service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.671168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-27419ccf-2d46-46a0-96cf-49f7f27be81b req-643f2d81-7f4c-4dc8-9750-675fb78c06de service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.691692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-27419ccf-2d46-46a0-96cf-49f7f27be81b req-643f2d81-7f4c-4dc8-9750-675fb78c06de service nova] Creating event network-changed:429d5db2-cf15-4c0a-adeb-c7310ca25fc9 for instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 on hv-cinder-85604 Sep 06 11:50:52.698844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-27419ccf-2d46-46a0-96cf-49f7f27be81b req-643f2d81-7f4c-4dc8-9750-675fb78c06de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051865 Sep 06 11:50:52.700098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 29/88] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:52.705946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:52.707386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:52.708272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:52.716718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.717327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24ad41b9-b8bc-45a8-8cc6-ed9ac367108b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.730167 Sep 06 11:50:52.717758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.718426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.719292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 60/89] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:52.719639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.720287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.720924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.724904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:52.725745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:52.742680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.748599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.750948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:52.752986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:52.757597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:52.758329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.264585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:53.305781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:53.314391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:53.316418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a4f23a7-9cfd-4977-95dc-03109f850698 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.614884 Sep 06 11:50:53.322988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 30/90] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:53.353935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:53.355933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:53.364960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.366552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.367347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.368628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.369464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.371017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.451770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:53.470572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1cfd973d-a0ce-4c39-ace1-2d114174bc82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.742864 Sep 06 11:50:53.471664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 61/91] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:52 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:53.672907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:53.674327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:53.681398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.687416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.687924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.688877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.689409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.689940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.807608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:53.816027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d81c025d-d514-4c03-a4d4-4ffd557f4569 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.478930 Sep 06 11:50:53.816516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 31/92] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:53 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:53.821384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:53.822048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:53.827837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.828461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.829073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.829812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.830272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.830697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.838802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:53.847439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41822d74-e5e5-4283-967c-ab83ca3ff913 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.179047 Sep 06 11:50:53.848032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 62/93] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:53.853411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb205f-f79a-4c52-b0e3-190868135839", "tag": "f1f133bf-a5b0-4fa4-a620-a0a7431dee95"}, {"name": "network-changed", "server_uuid": "276be2d2-5442-4aa5-9eda-a25444b0bfb0", "tag": "cbaef624-f760-407b-97bf-32231dc062bf"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:53.864280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:53.865549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:53.866092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:53.879606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] Creating event network-changed:f1f133bf-a5b0-4fa4-a620-a0a7431dee95 for instance 23cb205f-f79a-4c52-b0e3-190868135839 on hv-cinder-85604 Sep 06 11:50:53.880108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] Creating event network-changed:cbaef624-f760-407b-97bf-32231dc062bf for instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 on hv-cinder-85604 Sep 06 11:50:53.886901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-bf76805b-39c3-4f58-8dac-6a54c41b5ef9 req-fb1dcf24-1489-4983-86dd-45cf1b82da59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037483 Sep 06 11:50:53.887535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 63/94] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:54.012159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:54.021420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-43b1e5e7-ba7a-4559-9908-8c8408578844 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.203203 Sep 06 11:50:54.022045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 32/95] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:54.352750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:54.353403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:54.359704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.360191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.360722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.361380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.361912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.362340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.497491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:54.498223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:54.504948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.505988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.506409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:54.506636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.507362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.507791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.508221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.516100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:54.517791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:54.518919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6734f0bf-c6ee-406e-a73c-c4308a481c9b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.171276 Sep 06 11:50:54.519476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 64/96] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:54.713407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:54.723356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2fd19ff1-375d-44b4-a274-5d53e0b016e7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.230525 Sep 06 11:50:54.724890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 33/97] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:54 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:54.841096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:54.841938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:54.849793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.850293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.850754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.851451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.852126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.852549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.871902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:54.872508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:54.891661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.892554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.893609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:54.894919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:54.895771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:54.896483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.003996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.014898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-081b3803-5c47-42a1-982d-ce6383d4092a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.177423 Sep 06 11:50:55.016663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 65/98] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:54 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:55.046913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:55.047537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:55.057163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.057163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.058140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.058839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.059301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.059728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.075181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.086219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-79f7ac51-a35e-488d-9485-130a810b0116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.218287 Sep 06 11:50:55.087226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 34/99] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:55.199464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.207389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-259902ec-9c84-44b5-a2be-e1da60fc2ef6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.164284 Sep 06 11:50:55.208074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 66/100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:55.548282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:55.548998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:55.555484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.555965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.556391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.557080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.557524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.557978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.721234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.730478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.731915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.733020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2e7ec63-5ebc-41ed-9e65-e6f1c86ab886 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.188839 Sep 06 11:50:55.733704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 35/101] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:55.753899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:55.754508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:55.761025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.761504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.761965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.762651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:55.763101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:55.763527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:55.949910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:55.957528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73108662-81e0-4def-8ac7-8a8da200dbc0 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.207575 Sep 06 11:50:55.958091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 67/102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:55 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:56.042063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:56.043210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:56.051651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.052215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.053687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.054628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.055173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.055741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.109844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:56.110438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:56.118729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.119458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.119913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.120626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.121079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.121500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.262075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.273064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ef1d8410-5639-42cb-b4dd-409e708c15ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.236518 Sep 06 11:50:56.274306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 36/103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:56 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:56.289273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:56.289928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:56.299238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.300602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.301578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.303126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.304275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.305801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.323246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.341762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d3c197d1-c46e-41d4-905d-761e266d9538 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.235696 Sep 06 11:50:56.343277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 68/104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:56.551283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.560924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d7a827fb-d5f3-4e62-8681-dca2bd8a06af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.285317 Sep 06 11:50:56.561668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 37/105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:56.652558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-5797fff1-0d40-4a6d-a3d0-180d9f81cc97 req-d93f0336-a49b-4f2a-99bb-d05623707f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "name": "network-vif-plugged", "status": "completed", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:50:56.663925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5797fff1-0d40-4a6d-a3d0-180d9f81cc97 req-d93f0336-a49b-4f2a-99bb-d05623707f46 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.664305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5797fff1-0d40-4a6d-a3d0-180d9f81cc97 req-d93f0336-a49b-4f2a-99bb-d05623707f46 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.664732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5797fff1-0d40-4a6d-a3d0-180d9f81cc97 req-d93f0336-a49b-4f2a-99bb-d05623707f46 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.676349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-5797fff1-0d40-4a6d-a3d0-180d9f81cc97 req-d93f0336-a49b-4f2a-99bb-d05623707f46 service nova] Creating event network-vif-plugged:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 11:50:56.682610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-5797fff1-0d40-4a6d-a3d0-180d9f81cc97 req-d93f0336-a49b-4f2a-99bb-d05623707f46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124974 Sep 06 11:50:56.683445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 69/106] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:50:56.758821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:56.759459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:56.765983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.766472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.766913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.767618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.768190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.768623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.913736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.923583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.925158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:56.926331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09cf05eb-3016-43ce-83d0-0de40d9d5327 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.171594 Sep 06 11:50:56.926904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 38/107] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:56.983039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:56.983975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:56.994904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.995392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.995881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:56.996580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:56.997031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:56.997452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.166655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:57.176908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a4ea12d-7228-4891-8323-05734d2e987b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.198256 Sep 06 11:50:57.177901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 70/108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:56 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:57.297677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:57.298641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.305201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.309745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.309745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.309745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.309745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.310113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.365548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:57.366259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.381913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.382489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.382986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.383859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.384455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.385017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.515909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:57.532388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-301022cf-be95-42b6-ab48-f37a50e8bb83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.239561 Sep 06 11:50:57.534454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 39/109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:57 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:57.573093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:57.581283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e8fc961b-a75e-4c38-ae60-5a0ff21c25e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.219786 Sep 06 11:50:57.581996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 71/110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:57.593857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:57.593857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.593857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.593857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.594778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.594778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.594778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.594778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.732262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:57.740819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d6cab6d6-04aa-4084-a6a5-df4872becad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.160076 Sep 06 11:50:57.741545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 40/111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:57.950242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:57.959744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:57.960948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:57.968099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.968585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.969015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:57.969752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:57.970468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:57.970773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.116212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.126141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.127683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.128801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90eda817-54b4-4d37-89b9-15f0f89ec8f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.179927 Sep 06 11:50:58.129358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 72/112] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:58.204895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:58.205517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:58.211921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.212408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.212865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.213549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.214035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.214461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.350484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.358123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d38b7357-1a6f-46f0-80d0-2ed31481e992 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.157598 Sep 06 11:50:58.358691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 41/113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:58 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:58.556697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:58.557309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:58.563488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.563978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.564419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.565109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.565564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.566027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.606147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:58.606757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:58.612789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.613272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.613724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.614417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.614980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.615420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.701426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.710935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9b9d903d-69d2-4669-868e-2db91637253e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.157950 Sep 06 11:50:58.711530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 73/114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:58 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:58.746779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.754420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c8e4912-1a23-4879-b349-7b0acb1035b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.152068 Sep 06 11:50:58.755019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 42/115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:58.763792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:58.764505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:58.770748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.771758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.772195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.772877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:58.773325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:58.773768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:58.777663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:58.903206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:58.910871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a7d3b53d-519b-49fd-a3c4-9bd8ce9f0a0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.150885 Sep 06 11:50:58.911978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 74/116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:59.156424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:59.157084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:59.163961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.164438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.164874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.165561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.166049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.166471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.294815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.298253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:59.303959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.305410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.306554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-29269464-f723-4a24-abab-901bf4302270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.154071 Sep 06 11:50:59.307119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 43/117] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:50:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:50:59.383264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:59.383867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:59.389797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.390317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.391026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.391708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.392230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.392685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.526838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.534623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-664a9ade-b0e3-49ad-b849-a77e98483caf tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.155335 Sep 06 11:50:59.535210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 75/118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:59 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:59.733843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:59.734467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:59.740641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.741124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.741554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.742266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.742712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.743125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.778376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:59.778986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:59.785058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.785551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.786014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.786764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.787212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.787636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.884274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.892620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cba48d85-b8b4-45bc-aac8-c76cccb876fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.162808 Sep 06 11:50:59.893421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 44/119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:59 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:50:59.928113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:50:59.933987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:50:59.934622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:50:59.935775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a92c73a-9810-4db4-8387-2b2936c9de7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.161326 Sep 06 11:50:59.936354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 76/120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:50:59.940764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.941242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.941688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.942378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:50:59.943556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:50:59.944004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:50:59.998436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:00.080583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.088096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1d288e59-bbc0-45a9-8ab9-65ab0aa51ae9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.158053 Sep 06 11:51:00.088668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 45/121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:50:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:00.331439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.331953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.338977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.339440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.339864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.340540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.340984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.341398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.474344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.482434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.483882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.484958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6819dff4-5832-4882-be9e-85ed64ac5d5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.157579 Sep 06 11:51:00.485511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 77/122] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:00.557412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.558080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.564096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.564582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.565014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.565730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.566196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.566617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.697607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:00.706218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d7a1057a-b2b8-4335-a933-fc1867c33825 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.152527 Sep 06 11:51:00.706822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 46/123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:00.917699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.918394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.924737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:00.925137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.925636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.926096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.926810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.927981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.928467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.969916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:00.969916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:00.969916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.969916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.970602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:00.970602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:00.970602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:00.971136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.067417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.075344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6dae0872-2329-4158-9ccf-278c0113f289 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.161503 Sep 06 11:51:01.076243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 78/124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:01.101694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.109376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f2bfaaa-2b13-404e-83bf-87e2da1a91cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.152884 Sep 06 11:51:01.109967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 47/125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:01.110493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:01.111114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:01.117410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.117920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.118358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.119051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.119505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.119926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.248849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.257460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f30b0486-e64a-475b-946f-9ce14d4c311c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.150718 Sep 06 11:51:01.258063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 79/126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:01.510908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:01.511459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:01.517705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.518187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.518618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.519295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.519745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.520163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.656223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.665489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.666955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.668099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-40c8e119-e233-43da-82c4-6385aef3f8ad tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161140 Sep 06 11:51:01.668890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 48/127] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:01.729086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:01.729743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:01.735691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.736172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.736608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.737294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:01.737791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:01.738230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:01.873965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:01.882270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc0a5fd4-bcdb-455a-aa31-02e012e5fa0f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.157041 Sep 06 11:51:01.882836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 80/128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:01 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:02.100900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:02.101883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:02.113456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.114448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.116630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.118829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.119665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.120439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.132880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:02.133938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:02.140881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.141630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.142268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.143394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.144007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.144587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.274278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.282341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6cceec30-e468-4c70-8427-7c742d289e57 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.186994 Sep 06 11:51:02.285759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 49/129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:02 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:02.288693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:02.289597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:02.295755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.296987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.297523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.298370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.298934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.299454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.311155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.318954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9bfe695e-44b7-43e2-a5b8-417af4d3e7c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.190199 Sep 06 11:51:02.320395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 81/130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:02.437126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.445082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1173c2ac-8329-4d6b-aed1-b399a2f1ac8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.160708 Sep 06 11:51:02.445881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 50/131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:02.693174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:02.694362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:02.700325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.700794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.701214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.701923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.702373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.702781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.835804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.844695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.846233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:02.847358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-28972c2e-bf12-4b39-846f-449dc9cee339 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.158051 Sep 06 11:51:02.847923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 82/132] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:02.905598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:02.906193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:02.912087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.912566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.913470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:02.914180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:02.914634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:02.915057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.047966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:03.056942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-47a22ccd-3da1-436e-8531-4949cf768064 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.155248 Sep 06 11:51:03.057532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 51/133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:02 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:03.308434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:03.309047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:03.315029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.315506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.315940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.316626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.317076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.317495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.341749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:03.342359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:03.345240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:03.348753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.349235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.349687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.350915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.351568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.351989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.483252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:03.491610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e25629b-f8d8-4fb2-bb26-5f68850501a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.187501 Sep 06 11:51:03.492205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 83/134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:03 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:03.502023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:03.511790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0d33ebb9-bfb1-4c68-a289-3f5e722684c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.173568 Sep 06 11:51:03.513734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 52/135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:03.516143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:03.516883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:03.524454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.534146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.535023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.535782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.536435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.536820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.676484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:03.685180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d0df432f-f9e7-4caf-9347-b1c26a24400e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.180935 Sep 06 11:51:03.686054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 84/136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:03.878459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:03.878980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:03.885556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.886074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.886508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:03.887200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:03.887648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:03.888071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.023878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.031935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.033492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.034741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-164555df-6be4-4e6a-8988-a5f0f681f180 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.160128 Sep 06 11:51:04.035123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 53/137] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:04.080376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:04.080987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:04.087827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.088318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.088751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.089441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.089972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.090392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.227227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.234828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-69271a78-4d4f-4fb4-b9bd-50af527472b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.158566 Sep 06 11:51:04.235391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 85/138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:04 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:04.525974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:04.526790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:04.532909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.533388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.533871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.534828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.535007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.535420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.536939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:04.538453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:04.545866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.546364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.546798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.547488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.547937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.548357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.672318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.678665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6eb21947-9d44-4f5e-8226-426fc54bb377 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.160351 Sep 06 11:51:04.679572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 54/139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:04 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:04.691261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.699311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b2fbb655-3bac-4032-a997-e9d7d79fc7ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.166204 Sep 06 11:51:04.700087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 86/140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:04.714998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:04.715605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:04.721365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.721882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.722307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.723020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:04.723410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:04.723823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:04.852392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:04.860338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-65b399f0-c5b7-4bae-a88a-5c2bf7b3f7b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.149047 Sep 06 11:51:04.860919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 55/141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:05.059385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.059904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:05.065893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.066375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.066806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.067489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.067931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.068348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.205174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:05.213881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:05.215338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:05.216438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4bfd8920-56af-4e0e-b06a-ee690423a92e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161106 Sep 06 11:51:05.217003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 87/142] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:05.258628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.259320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:05.266143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.266632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.267067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.267769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.268266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.268695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.404483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:05.413984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a93ab3b-94af-41ca-b90e-d3c2970fa094 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.159721 Sep 06 11:51:05.414557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 56/143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:05 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:05.701903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.702682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:05.708897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.710056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.710498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.711207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.711659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.712116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.724376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.725057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:05.731364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.731861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.732299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.733248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.733443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.733899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.860951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:05.868886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dffdd972-e7e0-4e8b-b2e4-abe7d6481e6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.171326 Sep 06 11:51:05.869671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 88/144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:05 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:05.869918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:05.879307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b888c11-bca7-4569-b664-4f133532f7ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.158681 Sep 06 11:51:05.880095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 57/145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:05.883089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:05.883700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:05.889670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.890159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.890849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:05.891549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:05.892002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:05.892427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.030063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:06.037624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-69d6637a-1c5f-40c1-8b01-68cd6abe4ac9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.158685 Sep 06 11:51:06.038207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 89/146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:06.240279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:06.241465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:06.248028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.248577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.249010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.249616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.250151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.250574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.386505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:06.394799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:06.396241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:06.398561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-25709a97-219c-4490-acf8-89e6c246e258 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.162175 Sep 06 11:51:06.399355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 58/147] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:06.436399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:06.437016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:06.443070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.444092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.444487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.445171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.445624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.446074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.574872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:06.578301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:06.583667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1291d26c-82fd-4c9d-92f3-2f83366cef8a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.151154 Sep 06 11:51:06.584278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 90/148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:06 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:06.892711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:06.893328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:06.899437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.899924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.900362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.901053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.901506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.901957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.903511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:06.904125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:06.910051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.910536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.910969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:06.911660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:06.912115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:06.912720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.033489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.041737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-90d0c75b-ee25-4d94-ae69-a02aa0d68ce9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.153089 Sep 06 11:51:07.042330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 59/149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:06 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:07.043630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.051250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1355c6c4-17af-4c44-a3cb-6ffb7d50ee5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.151639 Sep 06 11:51:07.051807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 91/150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:07.060051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:07.060666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:07.067065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:07.067556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:07.067991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.069252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:07.069747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:07.070177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.089280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:07.199326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.207178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-23a61240-4404-44a0-8c53-aea4b9423ddc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.150769 Sep 06 11:51:07.207767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 60/151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:07.423733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:07.424340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:07.431741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:07.432234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:07.432666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.433348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:07.433837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:07.434258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.572636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.580773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.582272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.583408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a684c34b-3b0c-4482-9ba9-3e422af1f6db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.163651 Sep 06 11:51:07.583973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 92/152] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:07.607115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:07.607775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:07.613825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:07.614312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:07.614751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.616008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:07.616586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:07.617010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:07.753478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:07.762284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1e0b998d-7226-4c7a-b41f-af7857679e97 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.159064 Sep 06 11:51:07.762860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 61/153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:07 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:08.066351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:08.066959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:08.073573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.073744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:08.074199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.074297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:08.074502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.075192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.075646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.076064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.080134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.080621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.081061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.081778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.082234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.082668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.220251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.221039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.231751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ae23ddf-1058-4fd7-b49c-684764a6d04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.161815 Sep 06 11:51:08.231969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8cf3b0e-b5d0-4a40-b28c-ccd7a530fd15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.169309 Sep 06 11:51:08.232328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 62/154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:08.232722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 93/155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:08 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:08.236953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:08.237549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:08.244042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.244711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.245771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.246597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.247172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.247716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.392946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.404690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-93317967-99fb-4ca5-9a76-99f6b00b2c83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.171394 Sep 06 11:51:08.405257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 63/156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:08.608753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:08.609292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:08.615466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.615969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.616401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.617096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.617686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.618024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.762615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.771023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.773153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.774295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eacaf70a-78d8-4faa-91ca-5aeb0ad3c822 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.169506 Sep 06 11:51:08.774850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 94/157] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:08.785939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:08.786844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:08.795844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.796322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.796776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.797467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:08.797965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:08.798379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:08.932874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:08.940995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e479aadf-ce0c-4383-a0aa-a19374834b6a tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.159247 Sep 06 11:51:08.941871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 64/158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:08 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:09.255699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:09.256812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:09.257104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:09.257300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:09.263467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.263635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.263958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.264090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.264385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.264494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.265073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.265176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.265807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.265932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.266222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.266328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.400370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:09.401196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:09.410055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69f80483-789b-44ba-a21a-7ce64f148f90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.158051 Sep 06 11:51:09.410649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 65/159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:09 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:09.418871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99d1fbf8-7b0a-4f4a-b485-6112f61a6112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.166842 Sep 06 11:51:09.429694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 95/160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:09.436183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:09.436808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:09.444728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.445209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.445634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.446347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.446791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.447231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.575689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:09.583360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-819edfe8-1e7c-46c7-906c-dd2b6128cb69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.151947 Sep 06 11:51:09.583919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 66/161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:09.799095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:09.799711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:09.805976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.806462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.806922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.807607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.808055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.808476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.937207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:09.945943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:09.947409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:09.948540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e086bfc5-34f7-40b4-aa9f-1e269d89ea25 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.153416 Sep 06 11:51:09.949129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 96/162] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:09.965287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:09.965935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:09.971990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.972469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.972899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:09.973581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:09.974068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:09.974488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.107766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:10.115984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f53cde4f-0ff7-4c81-b680-628845345dda tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.154073 Sep 06 11:51:10.116684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 67/163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:09 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:10.436310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:10.436912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:10.444065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.445200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.445831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.446024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:10.446583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:10.446668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.447059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.447483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.452672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.453290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.453761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.454478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.454938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.455359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.588412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:10.596433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e7884cef-e8e9-47dd-9204-7c0f4b3cec89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.163906 Sep 06 11:51:10.597026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 97/164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:10 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:10.605270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:10.605995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:10.612341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.612830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.613262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.614009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.614452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.615005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.748903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:10.757947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:10.760559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b21541ec-aef3-4b07-96c4-141a26bc873a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.158991 Sep 06 11:51:10.761471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 98/165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:10.772412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-36ac724f-a5e2-455d-ad60-b4d651dd6f89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.331321 Sep 06 11:51:10.773842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 68/166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:10.974614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:10.975173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:10.981748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.982231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.982665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:10.983354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:10.983808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:10.984228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.121777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.129763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.131197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.132559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4b9acaf-a4ae-4c27-98a1-6e55936e4c69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161839 Sep 06 11:51:11.133122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 99/167] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:11.139211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:11.139938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:11.146352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.146924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.147463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.148226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.148752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.149243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.282734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.291796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b6ccbdf9-a00e-404d-9d8e-d1ddad4cf929 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.156595 Sep 06 11:51:11.292361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 69/168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:11 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:11.619908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:11.620510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:11.626671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.627145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.627569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.628247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.628686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.629101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.762626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.770529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dd6cfd41-b69f-49c4-8ecb-52b9ba7f242b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.154665 Sep 06 11:51:11.771099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 100/169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:11 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:11.784217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:11.784830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:11.791454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.791947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.792383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.793080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.793531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.793982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.796551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:11.797239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:11.803958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.804468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.805047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.805843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:11.806378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:11.806875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:11.935079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.942791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-924f4f7a-af64-46b9-b9c7-31a2bd75ef13 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.162752 Sep 06 11:51:11.943379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 70/170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:11.945573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:11.953193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ffd6813c-01db-40e3-8970-6a02543d4534 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.160871 Sep 06 11:51:11.953937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 101/171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:12.156743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:12.157288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:12.163311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.163847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.164299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.164973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.165416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.165866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.305892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:12.314397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:12.315824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:12.316928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-73949c47-0e87-4d8c-aee0-7945d2ebd931 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.164191 Sep 06 11:51:12.317486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 71/172] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:12.320552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:12.321249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:12.331265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.331752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.332180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.332869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.333316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.333754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.462824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:12.470555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e1fba88-ac58-4923-9305-910940634ad7 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.159268 Sep 06 11:51:12.471133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 102/173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:12 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:12.794875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:12.795486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:12.801439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.801950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.802376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.803055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.803502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.804987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.938449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:12.947111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d0eec937-6f52-464d-a5fc-a91c4165dfcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.156244 Sep 06 11:51:12.947683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 72/174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:12 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:12.966866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:12.967392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:12.973423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.973934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.974359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.975040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.975535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.976053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.976484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:12.977090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:12.982982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.983457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.983882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:12.984557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:12.985001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:12.985414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.113766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:13.122603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5ede1bfb-80b0-457d-88db-dfacd8ab9915 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.159945 Sep 06 11:51:13.123270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 103/175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:13.123752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:13.132123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5375bcc7-62b3-46a9-bdfd-addfbc8ee5b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.159503 Sep 06 11:51:13.132646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 73/176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:13.342048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:13.342663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:13.348604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:13.349084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:13.349518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.350234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:13.351235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:13.351620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.483406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:13.491932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:13.492932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:13.493346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:13.493545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:13.494507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d1de1383-5552-4be8-b1dc-587078f94738 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.156336 Sep 06 11:51:13.495181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 104/177] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:13.499722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:13.500206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:13.500642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.501339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:13.501826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:13.502259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.643391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:13.656978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-df4fe212-0869-4d41-b7b1-deb588ccc4fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.167694 Sep 06 11:51:13.657938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 74/178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:13 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:13.970359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:13.971131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:13.980593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:13.981078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:13.981715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.982409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:13.983009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:13.983428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:13.994900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-c97c86a8-91d5-40b8-9dac-d538a6062b79 req-13e65e12-7808-4aca-920f-cfdcc3cd88e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276be2d2-5442-4aa5-9eda-a25444b0bfb0", "name": "network-vif-plugged", "status": "completed", "tag": "cbaef624-f760-407b-97bf-32231dc062bf"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:14.004526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-c97c86a8-91d5-40b8-9dac-d538a6062b79 req-13e65e12-7808-4aca-920f-cfdcc3cd88e6 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.005225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-c97c86a8-91d5-40b8-9dac-d538a6062b79 req-13e65e12-7808-4aca-920f-cfdcc3cd88e6 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.005832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-c97c86a8-91d5-40b8-9dac-d538a6062b79 req-13e65e12-7808-4aca-920f-cfdcc3cd88e6 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.020004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-c97c86a8-91d5-40b8-9dac-d538a6062b79 req-13e65e12-7808-4aca-920f-cfdcc3cd88e6 service nova] Creating event network-vif-plugged:cbaef624-f760-407b-97bf-32231dc062bf for instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 on hv-cinder-85604 Sep 06 11:51:14.025964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-c97c86a8-91d5-40b8-9dac-d538a6062b79 req-13e65e12-7808-4aca-920f-cfdcc3cd88e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035340 Sep 06 11:51:14.026882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 75/179] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:14.123623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.132412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f951b780-e345-49d8-9655-110104836da5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.165038 Sep 06 11:51:14.133669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 105/180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:13 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:14.146483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:14.147849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:14.156974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.157172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:14.157692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:14.157958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.158525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.159491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.159991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.160560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.166319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.167104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.167671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.168522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.168976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.169398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.331173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.332000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.340456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0162557c-66da-49f7-a726-3cb87fc666bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.186853 Sep 06 11:51:14.340981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 106/181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:14.345584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bbfb7674-d671-49fb-8f59-c12696f7759e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.203170 Sep 06 11:51:14.358239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 76/182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:14.519217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:14.519884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:14.531192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.531192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.531192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.531192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.531471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.531471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.549706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:14.677553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.680240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:14.680860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:14.687035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.687342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.687555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.687966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.688659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:14.689116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:14.689539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:14.689667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.690757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d54125e5-72c5-47ea-a6bc-e4ce2e332af5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.175751 Sep 06 11:51:14.706689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 107/183] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:14.830152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:14.833784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:14.839462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-181d7238-eca8-4f29-9175-56d7a27b5270 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.163021 Sep 06 11:51:14.840048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 77/184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:14 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:15.156734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:15.157383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:15.163936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.164443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.164866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.166076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.166076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.166474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.319140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:15.328384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b092e423-c177-42d3-a7ca-0f9fd55bc803 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.175521 Sep 06 11:51:15.328978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 108/185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:15 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:15.363531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:15.364153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:15.370972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.371455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.371895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.372613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.372789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:15.373258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.373518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.373792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:15.380180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.380664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.381410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.382434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.383129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.383878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.561622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:15.570676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-060cdca3-3fb7-4998-95e8-66e6185811d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.210961 Sep 06 11:51:15.578180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 78/186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:15.578491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:15.586351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4edde624-5eb7-489b-a220-08082fd9fd3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.215930 Sep 06 11:51:15.586959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 109/187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:15.721557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:15.722220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:15.732569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.733319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.733938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.734797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.735389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.736005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.863478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:15.864410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:15.880315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.881165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.882526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.883567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:15.884068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:15.884544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:15.921539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:15.934928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:15.936396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:15.937585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b2bf551f-c120-4d88-a043-a79082e62f93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.223577 Sep 06 11:51:15.938255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 79/188] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:16.032098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:16.039834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2d10cb07-27a6-492c-a445-95c9f3102737 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.180097 Sep 06 11:51:16.040419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 110/189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:15 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:16.352663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:16.353275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:16.359604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.360104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.360530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.361251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.361721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.362139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.499215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:16.508884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7bca1fb9-e6ff-481e-9bc1-f68c0497c622 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.160695 Sep 06 11:51:16.509522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 80/190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:16 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:16.594010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:16.594634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:16.601996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.602487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.602929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.603763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.604317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.605124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.609937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:16.610566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:16.618000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.618578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.619024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.619763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.620197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.620623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.744135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:16.751903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-505a23c8-8c69-4eb7-9fe6-9b38ab678efc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.161832 Sep 06 11:51:16.752564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 111/191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:16.775341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:16.783439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f6f989f-ee4d-4a38-8c43-598444f47b3b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.177385 Sep 06 11:51:16.784024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 81/192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:16.965483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:16.966158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:16.973999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.974631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.976657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:16.977820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:16.978420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:16.979039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.075116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:17.076283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:17.087772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.088266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.088694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.090059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.090668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.091237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.180307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.189234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.191166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.193079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c55a47ed-8cb4-44fc-b8a1-e9e68776d627 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.231872 Sep 06 11:51:17.195665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 112/193] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:17.319184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.329010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b4b69e31-8eb3-40b7-9d5f-4181a61a85b6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.261069 Sep 06 11:51:17.329595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 82/194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:17 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:17.534100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:17.535069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:17.542156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.542648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.543084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.543847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.544302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.545031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.730175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.739499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99fb4f04-71f3-44ae-99db-de10556b77f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.209546 Sep 06 11:51:17.745804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 113/195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:17 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:17.777948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:17.778813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:17.784841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.785468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.785927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.786612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.787052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.787670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.807952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:17.808760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:17.815642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.816246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.816552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.817255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:17.817738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:17.818159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:17.950657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.960043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7b9abfb-7afb-48d8-b60d-19c66b0ed718 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.187349 Sep 06 11:51:17.960784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 83/196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:17.974011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:17.983313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-defa2601-d39f-409d-92b7-031b729d4bcd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.179938 Sep 06 11:51:17.983894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 114/197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:18.220045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:18.220875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:18.230230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:18.230230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:18.230230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:18.230230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:18.230545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:18.230545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:18.353885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:18.354666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:18.363195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:18.364150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:18.364742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:18.366827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:18.367535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:18.367959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:18.411204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:18.422022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:18.423529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:18.424811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a79e7047-7b42-4dcf-88a1-0fe3519de92c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.208515 Sep 06 11:51:18.425853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 84/198] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:18.556766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:18.566703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f2a525d9-e301-41fd-9eac-0063e7590d48 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.217827 Sep 06 11:51:18.567527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 115/199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:18 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:18.764936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:18.766080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:18.772842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:18.773169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:18.773628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:18.774413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:18.774864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:18.775282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:18.963919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:18.973602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-47e9cf46-6966-473e-9830-c0643e264528 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.212971 Sep 06 11:51:18.974186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 85/200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:18 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:18.988341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:18.989934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:19.001718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.002207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.003041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.004046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.004606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.005241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.007653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:19.009091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:19.015882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.016588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.017181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.018054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.018671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.019285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.370625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:19.382345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-90364643-882d-4c17-8200-c2f6933e5590 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.378812 Sep 06 11:51:19.383208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 86/201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:19.457156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:19.457980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:19.464934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.465707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.466363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.467404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.468039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.468563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.616774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:19.625039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:19.626648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:19.627975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-315f89fd-16f0-415b-9dce-6923ad8bb1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.175199 Sep 06 11:51:19.628933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 87/202] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:19.633635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:19.634429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:19.647063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.648251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.648876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.649675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:19.650139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:19.650563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:19.700090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:19.708508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7183bb26-aeac-4f08-bff5-71409fa78031 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.728114 Sep 06 11:51:19.711087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 116/203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:19.784549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:19.793700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1f022ad1-71c3-440d-bade-7dd0c2118e7c tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.163933 Sep 06 11:51:19.794320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 88/204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:19 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:20.000997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:20.002420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:20.011885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.012704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.013363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.014671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.015343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.016446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.030535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-6da7eef9-d27e-4690-8874-8616a61de045 req-be29a054-2714-4f1f-bed5-92afd6c4ca3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d49777e-ab48-453f-8bef-9b496e07fb75", "name": "network-vif-plugged", "status": "completed", "tag": "1754716f-7e60-43f8-8750-dac04f227184"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:20.051393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6da7eef9-d27e-4690-8874-8616a61de045 req-be29a054-2714-4f1f-bed5-92afd6c4ca3b service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.055137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6da7eef9-d27e-4690-8874-8616a61de045 req-be29a054-2714-4f1f-bed5-92afd6c4ca3b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.056928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6da7eef9-d27e-4690-8874-8616a61de045 req-be29a054-2714-4f1f-bed5-92afd6c4ca3b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.117343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-6da7eef9-d27e-4690-8874-8616a61de045 req-be29a054-2714-4f1f-bed5-92afd6c4ca3b service nova] Creating event network-vif-plugged:1754716f-7e60-43f8-8750-dac04f227184 for instance 8d49777e-ab48-453f-8bef-9b496e07fb75 on hv-cinder-85604 Sep 06 11:51:20.131107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-6da7eef9-d27e-4690-8874-8616a61de045 req-be29a054-2714-4f1f-bed5-92afd6c4ca3b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105780 Sep 06 11:51:20.134310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 89/205] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:51:20.415422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:20.416188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:20.431147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:20.434388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.435641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.436076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.436814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.437278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.437730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.440444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d553e41a-3c1a-4a6e-b8af-2ad0406b23b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.445632 Sep 06 11:51:20.444343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 117/206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:19 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:20.649627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:20.658447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:20.659470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:20.659675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00054459-2ff9-4717-9e8d-02ca7141c695 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.254681 Sep 06 11:51:20.670266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.671082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.671844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.672699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.673389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.674105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.698106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 90/207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:20.734627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:20.735256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:20.747321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.750417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.751101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.755467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.756285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.758085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.907102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:20.916647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:20.942428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:20.943628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a3dbe387-5dfd-4c98-bd3b-8940a716c07e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.293087 Sep 06 11:51:20.945039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 118/208] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:51:20.952960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:20.953795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:20.969326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.969857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.970324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.970973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:20.971593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:20.972090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:20.977603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:20.990047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-96f0aec2-b742-44f4-beed-3e7cf9d5bba5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.260626 Sep 06 11:51:20.998307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 91/209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:21.127172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:21.135341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8a89b6e3-5a0a-4bb3-9e3f-6fafdb944749 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.188934 Sep 06 11:51:21.135919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 119/210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:20 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:21.466899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:21.467501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:21.473547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:21.474092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:21.474896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:21.475492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:21.475949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:21.476374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:21.631077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:21.639672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c545a7ac-1c89-407f-b76b-fabd18975c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.176528 Sep 06 11:51:21.640264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 92/211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:21 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:21.691337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:21.691943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:21.698459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:21.698931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:21.699358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:21.700032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:21.700479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:21.700892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:21.836513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:21.844838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f851261-3d02-458d-a86d-caf50e4cfc79 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.157251 Sep 06 11:51:21.845528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 120/212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:21.973459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:21.974092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:21.980158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:21.980635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:21.981063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:21.981769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:21.982220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:21.982639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.017911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:22.018555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:22.026735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.027852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.027968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.028662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.029116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.029540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.113201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.126030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.127815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.129104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ba2a36a-f6c4-4dce-9f2d-f43e98469f4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.160063 Sep 06 11:51:22.129685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 93/213] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:22.160223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:22.160831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:22.167585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.168366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.168479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.169169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.169613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.170052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.177465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.185638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a852727-1f6d-4b75-bc4e-afa1856907bf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.171656 Sep 06 11:51:22.186243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 121/214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:22.190825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-ab2929f7-b4d5-40d3-9aa1-8c7af954f30d req-6dc0c019-568a-46c7-8404-306335791461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2942181c-63de-4194-946d-9d8ca5c4b4a3", "name": "network-vif-plugged", "status": "completed", "tag": "429d5db2-cf15-4c0a-adeb-c7310ca25fc9"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:22.201767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-ab2929f7-b4d5-40d3-9aa1-8c7af954f30d req-6dc0c019-568a-46c7-8404-306335791461 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.201870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-ab2929f7-b4d5-40d3-9aa1-8c7af954f30d req-6dc0c019-568a-46c7-8404-306335791461 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.202373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-ab2929f7-b4d5-40d3-9aa1-8c7af954f30d req-6dc0c019-568a-46c7-8404-306335791461 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.214006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-ab2929f7-b4d5-40d3-9aa1-8c7af954f30d req-6dc0c019-568a-46c7-8404-306335791461 service nova] Creating event network-vif-plugged:429d5db2-cf15-4c0a-adeb-c7310ca25fc9 for instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 on hv-cinder-85604 Sep 06 11:51:22.220097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-ab2929f7-b4d5-40d3-9aa1-8c7af954f30d req-6dc0c019-568a-46c7-8404-306335791461 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032635 Sep 06 11:51:22.220922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 122/215] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:22.324650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.332283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c30fdec-873e-43cf-9eee-1282cf4ddbd4 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.175803 Sep 06 11:51:22.332864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 94/216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:22 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:22.665822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:22.666684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:22.673559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.674066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.674495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.675183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.675629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.676044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.813088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:22.821238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1d60d1ba-d923-4f46-b19d-5093da647438 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.160709 Sep 06 11:51:22.821836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 123/217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:22 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:22.867981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:22.868511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:22.874576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.875057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.875487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.876171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:22.876618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:22.877041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:22.881178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:23.005743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.013805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0760f088-f475-4094-878f-dd215afada2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.149964 Sep 06 11:51:23.014377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 95/218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:23.154903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:23.155402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:23.161363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.161873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.162303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.163374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.163622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.164038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.211710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:23.212319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:23.218198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.218707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.219138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.219817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.220267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.220686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.301619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.306636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:23.317563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.320138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.321394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-097ec317-d433-4782-8ecb-62e2225a0809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.170516 Sep 06 11:51:23.322404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 124/219] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:51:23.354762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:23.355382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:23.361541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.362062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.362500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.363202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.363665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.364095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.372782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.380600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-968c77e4-7bfd-446e-babb-507499365d86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.173920 Sep 06 11:51:23.381263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 96/220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:23.491717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.499323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f11069a-779a-4c02-a1b0-42a222fad2fe tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.148940 Sep 06 11:51:23.499901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 125/221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:23 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:23.845055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:23.845580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:23.852218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.852693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.853124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.853850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:23.854306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:23.854743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:23.986526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:23.995221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dd4c881e-490a-4584-82f9-4fa789ccc433 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.154076 Sep 06 11:51:23.995819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 97/222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:23 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:24.037843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:24.038454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:24.046124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.046584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.047074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.047920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.048386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.048836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.202907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:24.211465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-84a07d7b-b132-4be6-81a2-bee20391d856 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.177672 Sep 06 11:51:24.212147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 126/223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:24.348357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:24.348931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:24.356247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.356723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.357146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.357860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.358309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.358720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.405609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:24.406248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:24.412406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.413573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.414083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.414841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.415300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.415839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.496691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:24.505081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:24.506674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:24.507966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb164bb6-f66b-4462-8154-712d90d690a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.163540 Sep 06 11:51:24.508610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 98/224] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:24.524276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:24.525042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:24.531308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.531795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.532232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.532928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:24.533380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:24.533838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:24.554378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:24.562052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cb01bde1-adb9-44a8-8f54-89c5bdb14f8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.160418 Sep 06 11:51:24.562626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 127/225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:24.673546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:24.682013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91ece520-c286-4012-8976-1724155fcb28 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.164130 Sep 06 11:51:24.682593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 99/226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:24 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:25.019701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:25.020595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:25.024098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:25.028247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.028732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.029183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.029899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.030351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.030775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.164851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.172478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37339e2a-9784-4a46-b72b-f759a75782d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.157080 Sep 06 11:51:25.173059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 128/227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:25 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:25.235602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:25.236215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:25.242446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.242924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.243360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.244054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.244508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.244928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.377019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.385864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20d0f530-3f81-4e9a-a3d2-de335cdc63d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.153909 Sep 06 11:51:25.386607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 100/228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:25.532516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:25.533115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:25.539188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.539668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.540098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.540783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.541229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.541667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.584197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:25.584719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:25.591435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.591949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.592383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.593374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.593867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.594295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.680432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.688910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.690445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.691575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f0f4d495-b91c-40d8-9705-b942a645f4d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.163033 Sep 06 11:51:25.692527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 129/229] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:25.704141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:25.704863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:25.710960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.711437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.711863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.712551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:25.712995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:25.713413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:25.733288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.741694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6236e097-68bb-48f8-9e7a-68dfca20c207 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.160765 Sep 06 11:51:25.742296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 101/230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:25.859936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:25.868152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0b659617-39b1-4eca-8de8-739cf31af018 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.167741 Sep 06 11:51:25.868715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 130/231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:25 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:26.195392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:26.196006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:26.198923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:26.202966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.203447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.203878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.204560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.205009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.205428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.336620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.345107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2ef8c2a5-bf99-4cca-bdde-872b14132498 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.154078 Sep 06 11:51:26.345787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 102/232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:26 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:26.410473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:26.411085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:26.417201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.417718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.418158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.418852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.419307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.419739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.557943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.565473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-95a44765-7b26-49ce-a5f6-c5b5e8313aef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.158885 Sep 06 11:51:26.566073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 131/233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:26.717173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:26.717813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:26.723841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.724326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.724764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.726039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.726664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.727093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.764582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:26.765105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:26.771389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.771875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.772940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.773669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.774128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.774550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.872267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.880510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.882057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.883171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4d84b4cc-36b8-4e3a-9d99-2c4952cc78c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.169925 Sep 06 11:51:26.883731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 103/234] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:26.892376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:26.893177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:26.899355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.900053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.900642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.901486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:26.901968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:26.902392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:26.918907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:26.926601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-695f40a8-17ce-4174-aee2-f8685caff6ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.165931 Sep 06 11:51:26.927372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 132/235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:27.030396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:27.038530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9730969-a66d-49d0-a022-c1867c18f34d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.149738 Sep 06 11:51:27.039093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 104/236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:26 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:27.368166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:27.368788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:27.374817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.375308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.375751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.376447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.376912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.377340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.510861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:27.520569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d2422e77-e259-4321-a35e-001eef5fd969 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.156339 Sep 06 11:51:27.521139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 133/237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:27 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:27.590600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:27.591441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:27.598036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.598525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.598999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.599701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.600750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.601380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.735436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:27.743697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-47c4e76f-2563-4f29-9e31-6ce9165bc164 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.159258 Sep 06 11:51:27.744269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 105/238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:27.908654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:27.909573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:27.917356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.917891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.918329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.919195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.919661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.920083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.950885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:27.951410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:27.957356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.957878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.958312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:27.959006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:27.959987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:27.960434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.059236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.068050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.070114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.071236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aaf94d61-adbf-4aa1-a022-ca5137d8c172 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.166606 Sep 06 11:51:28.071802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 134/239] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:28.076228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:28.077513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:28.083312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.083795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.084227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.086019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.086500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.087125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.095740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.104173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e35ae11a-3832-462f-8d72-3d8b80ff37f9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.157166 Sep 06 11:51:28.104750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 106/240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:28.236314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.245140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1ed3d4ce-549a-4b07-a4d7-f4fc1f087f72 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.172376 Sep 06 11:51:28.245728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 135/241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:28 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:28.543228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:28.543743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:28.549677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.550155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.550576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.551246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.551688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.552099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.685414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.693134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b95124c8-b963-46cd-8d7f-30e12a021e6d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.153769 Sep 06 11:51:28.693740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 107/242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:28 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:28.767889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:28.768497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:28.780153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.781712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.782172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.783944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:28.785506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:28.786376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:28.932522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:28.940867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fea09164-3a38-4cbf-becf-1622dae69325 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.177061 Sep 06 11:51:28.941456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 136/243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:29.096434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:29.096965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:29.103000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.103480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.103915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.104636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.105089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.105542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.127225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:29.127870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:29.136142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.136636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.137077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.137846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.138288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.138713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.250317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.260164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.261616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.263515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e91eb72f-c470-4483-a07e-a8914a692573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.170292 Sep 06 11:51:29.267877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 108/244] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:29.272921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:29.273369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:29.279625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.280109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.280539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.281228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.281713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.282137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.285014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.293025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab7530b1-64c2-49c9-ad8f-fd382a9e4805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.169642 Sep 06 11:51:29.293701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 137/245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:29.409735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.418512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a35afb06-43bd-49f1-88fe-f1b2bdc788df tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.149554 Sep 06 11:51:29.419089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 109/246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:29 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:29.723723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:29.724337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:29.731213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.731702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.732139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.732839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.733291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.733807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.870233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:29.878293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73b391a6-2f84-4f5a-8b09-4106a9cf6a78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.158589 Sep 06 11:51:29.878873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 138/247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:29 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:29.964921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:29.965484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:29.971541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.972023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.972452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:29.973141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:29.973591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:29.974044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.101736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:30.109393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-caa37d20-2e1f-4c6c-9e1b-52a99694bb47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.148379 Sep 06 11:51:30.110002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 110/248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:30.288736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:30.289335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:30.295270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.295741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.296172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.296873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.297279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.297906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.317519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:30.318173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:30.325264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.325819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.326258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.326946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.327393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.327810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.434287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:30.443026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:30.445044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:30.446218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-35bdeb9f-f227-4790-9f39-bfe0a2451abb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161713 Sep 06 11:51:30.446765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 139/249] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:51:30.451354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:30.451955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:30.458765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.459415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.460433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.461148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.461609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.462063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.465623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:30.469009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:30.475013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81a68956-7ac1-4340-a830-e97b6ec512f4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.161224 Sep 06 11:51:30.476271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 111/250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:30.603423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:30.611735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66a15561-c166-4c58-b5cb-62f18749fd04 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.163939 Sep 06 11:51:30.612319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 140/251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:30 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:30.903036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:30.903674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:30.909983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.910460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.910890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:30.911566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:30.912013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:30.912436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.041782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.049469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-860c46c4-d8a3-4ba6-954b-3b5532218702 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.150269 Sep 06 11:51:31.050069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 112/252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:30 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:31.132464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:31.133182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:31.139230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.139714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.140149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.141096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.141554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.142008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.161289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:31.274158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.281934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-95356594-a69a-4642-89a3-c8a87f443852 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.153444 Sep 06 11:51:31.282570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 141/253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:31.472286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:31.472885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:31.479663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.480132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.480555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.481225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.481680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.482096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.498357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:31.499005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:31.506354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.506843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.507279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.508079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.508440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.508864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.618804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.627599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.629069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.630353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-39fdf53c-0194-48ba-9279-d7ed97b35de7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161947 Sep 06 11:51:31.630856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 113/254] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:31.635662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:31.636286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:31.642752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.643379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.643819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.644518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:31.644972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:31.645396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:31.661286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.669551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c86b0942-5abf-4514-a525-3f38fb73ed47 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.175758 Sep 06 11:51:31.670156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 142/255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:31.773102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:31.780788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0bde23c8-9a7f-48ec-81d5-82724e44ff61 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.148968 Sep 06 11:51:31.781419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 114/256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:31 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:32.073354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:32.073930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:32.079804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.080290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.080729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.081420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.081906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.082332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.224746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.233835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99475ad7-dc5e-4fdf-8f2e-4a2a38471297 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.165113 Sep 06 11:51:32.234422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 143/257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:32 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:32.305941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:32.306553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:32.312567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.313051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.313483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.314207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.314662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.315086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.445908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.453583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-493db45a-c685-4dfa-9e69-a6c25ddab33d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.152082 Sep 06 11:51:32.454188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 115/258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:32.658976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:32.659590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:32.666336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.666825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.667263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.667960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.668419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.668849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.692687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:32.693288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:32.699801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.700285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.700709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.701430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.702009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.702330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.802866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.812472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.814001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.815124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0a9fce16-da4f-4490-a098-2686ee4b8884 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161925 Sep 06 11:51:32.815686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 144/259] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:32.820196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:32.820801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:32.826677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.827161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.827593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.828309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:32.828736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:32.829154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:32.841488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.863761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6fd5fb36-5c02-47f5-aae8-91d444237962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.174146 Sep 06 11:51:32.878627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 116/260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:32.986267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:32.995842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-33346f76-1b80-468c-ae0c-b1a202ddc2fa tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.179105 Sep 06 11:51:32.996441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 145/261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:32 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:33.258172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:33.258776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:33.264812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.265281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.266017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.266696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.267137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.267549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.402467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:33.410189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-430c7b86-e13c-4503-b0fc-7280750fd8eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.155813 Sep 06 11:51:33.410769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 117/262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:33 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:33.477216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:33.478032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:33.486090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.486580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.487260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.487715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.488172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.488597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.623075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:33.630921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8f372a96-511d-488b-80ba-b5d199d13fc0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.157863 Sep 06 11:51:33.632007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 146/263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:33.840472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:33.840985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:33.846878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.847348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.847795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.848463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.848905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.849314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.888968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:33.889589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:33.895975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.896463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.896957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.897678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:33.898130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:33.898556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:33.986782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:33.995619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:33.997075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:33.998215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6dba648b-263f-4dc4-b976-76b989811774 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161706 Sep 06 11:51:33.998781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 118/264] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:34.018239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:34.018855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:34.025457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.025963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.026492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.027428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.027881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.028070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.040035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:34.051864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e0095d9-2a26-42ae-9317-8931a9ea8567 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.166254 Sep 06 11:51:34.052766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 147/265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:34.177135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:34.185856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-06184cbe-8832-435d-8e2a-a8cd058d6ce3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.171680 Sep 06 11:51:34.186429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 119/266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:34 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:34.434616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:34.435203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:34.441213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.441725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.442162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.443109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.443954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.444689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.582607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:34.591482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71764150-7b3d-4a67-842c-f574b044dee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.160826 Sep 06 11:51:34.592331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 148/267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:34 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:34.656950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:34.657556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:34.664298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.664780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.665207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.665974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:34.666432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:34.666852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:34.802391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:34.810453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3587770-8c5b-49dd-a8c7-b1da189d4612 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.158289 Sep 06 11:51:34.811234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 120/268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:35.024882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:35.025495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:35.031586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.032104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.032539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.033228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.033706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.034131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.077306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:35.078065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:35.084089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.085824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.086341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.087108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.087633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.088120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.166813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.175186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.176641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.177812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-52bb81d0-5a17-4538-a353-419ee38ec8eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.157617 Sep 06 11:51:35.178421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 149/269] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:35.208392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:35.209112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:35.215675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.216170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.216616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.217331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.217796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.218230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.219062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.227245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-065925df-76c4-4890-8b35-5f2e4932edbe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.153791 Sep 06 11:51:35.227826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 121/270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:35.371706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.379339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66274339-ebe5-44c8-9f3a-720e9a9d11e6 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.174904 Sep 06 11:51:35.379902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 150/271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:35 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:35.623332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:35.624508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:35.633791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.634481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.635184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.636504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.637336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.638122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.776226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.783847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e5be8a28-2468-458a-a230-291a80d363f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.169322 Sep 06 11:51:35.784418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 122/272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:35 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:35.833904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:35.834740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:35.846193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.846677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.847143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.847838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:35.848292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:35.848744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:35.985569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:35.993998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe80d301-cc6d-47e2-ad1b-80bc6194814d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.163828 Sep 06 11:51:35.994570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 151/273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:36.204586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:36.205235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:36.212267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.212753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.213174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.213904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.214357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.214779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.250906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:36.251730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:36.258476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.258966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.259396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.260158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.260551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.260966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.360072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:36.368773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:36.370659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:36.371894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-83ad96cd-316c-45d9-988f-9fa19e1f7e01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.171345 Sep 06 11:51:36.385676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 123/274] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:36.404093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:36.405593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:36.411738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.412819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.413475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.414206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.414648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.415077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.426882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:36.438532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f65851d9-69d4-4e04-a9c2-b878e1279c20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.191371 Sep 06 11:51:36.439495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 152/275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:36.558491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:36.565886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bf1bd697-5682-4824-aac3-8a4251a3ba3f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.165620 Sep 06 11:51:36.566447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 124/276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:36 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:36.807494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:36.808208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:36.814063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.814549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.814982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.815687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:36.816137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:36.816563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:36.949947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:36.957906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e666042-bd07-435f-891e-ad91c0f1d349 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.154112 Sep 06 11:51:36.958472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 153/277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:36 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:37.016447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:37.016993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:37.023585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.024054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.024490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.025182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.025637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.026087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.332131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:37.339822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cd58a454-0b89-44c1-8384-83c6b9c743dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.327559 Sep 06 11:51:37.340383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 125/278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:37.398920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:37.399645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:37.405693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.406184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.406623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.407313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.407768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.408192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.463059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:37.463775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:37.470010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.470570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.471066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.471822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.472348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.472820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.544731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:37.553141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:37.555275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:37.556482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f1e3170d-237c-4f71-8895-f292038a7d26 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.161681 Sep 06 11:51:37.557045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 154/279] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:37.596305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:37.596824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:37.603406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:37.604298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.604780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.605218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.605945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.606396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.606813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.611482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9ab2b861-41e8-43ae-9183-a18fa8ac3d25 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.153139 Sep 06 11:51:37.612163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 126/280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:37.740275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:37.748215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e0edd2c3-ff12-4fd0-b005-5ac05e463952 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.155849 Sep 06 11:51:37.748828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 155/281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:37 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:37.980472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:37.981109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:37.987459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.987936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.988360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.989479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:37.989882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:37.990354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:37.997408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-9f052eaf-3bf0-48d5-a555-ad6083d2a62c req-a09d55df-003d-4fb9-b3f2-90654e07cbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cb205f-f79a-4c52-b0e3-190868135839", "name": "network-vif-plugged", "status": "completed", "tag": "f1f133bf-a5b0-4fa4-a620-a0a7431dee95"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:38.008020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-9f052eaf-3bf0-48d5-a555-ad6083d2a62c req-a09d55df-003d-4fb9-b3f2-90654e07cbae service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.008519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-9f052eaf-3bf0-48d5-a555-ad6083d2a62c req-a09d55df-003d-4fb9-b3f2-90654e07cbae service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.008961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-9f052eaf-3bf0-48d5-a555-ad6083d2a62c req-a09d55df-003d-4fb9-b3f2-90654e07cbae service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.025386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-9f052eaf-3bf0-48d5-a555-ad6083d2a62c req-a09d55df-003d-4fb9-b3f2-90654e07cbae service nova] Creating event network-vif-plugged:f1f133bf-a5b0-4fa4-a620-a0a7431dee95 for instance 23cb205f-f79a-4c52-b0e3-190868135839 on hv-cinder-85604 Sep 06 11:51:38.031101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-9f052eaf-3bf0-48d5-a555-ad6083d2a62c req-a09d55df-003d-4fb9-b3f2-90654e07cbae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037978 Sep 06 11:51:38.031919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 156/282] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:38.180803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.188772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2af09048-6b15-4fc4-9a3f-66dae7bfb052 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.212133 Sep 06 11:51:38.189683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 127/283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:37 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:38.363560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:38.364139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:38.370846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.371336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.371775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.372477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.372934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.373361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.505676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.513560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b60323a8-7462-4854-aab3-0932ebb44f83 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.154368 Sep 06 11:51:38.514162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 157/284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:38.580764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:38.581793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:38.588283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.588791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.589229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.589947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.590472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.590916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.612448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:38.635275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:38.636017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:38.642833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.643332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.643891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.644997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.645528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.646354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.745600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.754563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.756859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.758287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8aaab39e-0a8c-4f8e-86f7-86c0266d2c89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.181527 Sep 06 11:51:38.759339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 128/285] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:38.772742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:38.773722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:38.780240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.780761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.781255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.782023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:38.782474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:38.782898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:38.800100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.803709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:38.808804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37034635-4bdf-4ba1-9278-97f8d5a1e57d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.177896 Sep 06 11:51:38.809527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 158/286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:38.911776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:38.919591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0decb3a-711a-4316-b5c1-8c0de3ac75dd tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.151619 Sep 06 11:51:38.920162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 129/287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:38 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:39.212384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:39.213009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:39.219402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.219896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.220333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.221040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.221526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.222261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.361310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:39.375876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a107d9eb-a788-4351-80dc-3189ddb81824 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.167380 Sep 06 11:51:39.376899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 159/288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:39 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:39.539131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:39.540588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:39.546572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.546881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.547231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.548324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.548785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.549194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.706692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:39.715585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-50d39c55-a008-4a5d-aca8-2b2ac69a4853 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.181169 Sep 06 11:51:39.716174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 130/289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:39.784365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:39.784964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:39.791555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.792113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.792539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.793223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.793694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.794132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.833013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:39.835601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:39.846198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.846692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.847138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.848463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.849255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.850463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.952862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:39.964276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:39.965803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:39.967344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af591c6f-6573-44f9-99c0-a5c7631ae66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.187055 Sep 06 11:51:39.968096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 160/290] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:39.972973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:39.973975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:39.981144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.981939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.982592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:39.983640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:39.984299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:39.984954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:40.055291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:40.063646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-211db99c-76d9-4017-bd01-dbe116aefbe5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.235101 Sep 06 11:51:40.064233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 131/291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:40.169459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:40.177790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b49ac86c-a531-469e-97b5-41266f25133f tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.208234 Sep 06 11:51:40.178645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 161/292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:39 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:40.400463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:40.401091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:40.408802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:40.409291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:40.409752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:40.410461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:40.410910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:40.411552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:40.685387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:40.694649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e9e2b7cf-f7fb-4bae-8cc1-b4ec7a18f42d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.297929 Sep 06 11:51:40.695715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 132/293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:40 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:40.742829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:40.743350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:40.749934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:40.750970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:40.751705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:40.752833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:40.753211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:40.753861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:40.964552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:40.974064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-845febae-e3b1-48f7-84dc-b601738629ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.236027 Sep 06 11:51:40.986505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 162/294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:40.997141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:40.998804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:41.009136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.009626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.010088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.010793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.011250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.011770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.094314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:41.095170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:41.102769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.103260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.103695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.104393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.104845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.105279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.163194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:41.172272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:41.173732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:41.175179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3d9186a1-0d27-4f3b-97ec-cb341d9a0924 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1406 microversion: 2.20 time: 0.182583 Sep 06 11:51:41.175737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 133/295] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:41.206562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:41.207981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:41.216675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.217162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.217588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.218608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.219422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.220051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.292225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:41.300072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92827a76-812c-4181-8995-00e1472da9d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.217180 Sep 06 11:51:41.300732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 163/296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:41.423206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:41.431594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-248330f7-1661-4dae-99c9-6dd66d73bfd8 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.229874 Sep 06 11:51:41.432183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 134/297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:41 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:41.720212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:41.721218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:41.728810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.729389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.729961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.730754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:41.731211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:41.731644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:41.882764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:41.891074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d779f9ce-7848-4562-a914-38a1b41aad30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1322 microversion: 2.1 time: 0.174615 Sep 06 11:51:41.891707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 164/298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:41 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:41.999902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:42.000519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:42.007894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.008623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.009131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.009971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.010499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.011011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.210414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:42.211238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:42.218000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.218609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.219169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.219978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.221063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.222022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.240138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:42.259969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-55458820-37bb-433f-97e6-7eb88c19599e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.260251 Sep 06 11:51:42.261740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 135/299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:42.328789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:42.330985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:42.339346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.340109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.340775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.341476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.353619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.353619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.430379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:42.442369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:42.444912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:42.446700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a279df76-ab44-488e-9100-3bc585bb4b77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1598 microversion: 2.20 time: 0.241987 Sep 06 11:51:42.447257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 165/300] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:51:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1598 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:51:42.457525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:42.462057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:42.472210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.472690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.473116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.474002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.474285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.475353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.541156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:42.548758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e77953e-ecf7-44c0-8975-75c7bc3bae00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.228673 Sep 06 11:51:42.550321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 136/301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:42.555587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:42.556301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:42.568345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.569079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.569691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.571510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.572166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.572746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.644813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:42.655349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b2f16360-dd81-456a-871b-64cf0af77c36 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.203943 Sep 06 11:51:42.656313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 166/302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:42 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:42.675173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-7743aefc-a951-4bd7-8cd0-5bab6b61c2fe req-8c5e4ffa-eee1-4071-b845-632c74a7a3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0412c-b404-44d6-8460-ba2be7a0ccdb", "name": "network-vif-plugged", "status": "completed", "tag": "94bc6936-1b5d-4a19-89d7-83fb58d05514"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:42.685943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-7743aefc-a951-4bd7-8cd0-5bab6b61c2fe req-8c5e4ffa-eee1-4071-b845-632c74a7a3b1 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.686655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-7743aefc-a951-4bd7-8cd0-5bab6b61c2fe req-8c5e4ffa-eee1-4071-b845-632c74a7a3b1 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.687085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-7743aefc-a951-4bd7-8cd0-5bab6b61c2fe req-8c5e4ffa-eee1-4071-b845-632c74a7a3b1 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.700616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-7743aefc-a951-4bd7-8cd0-5bab6b61c2fe req-8c5e4ffa-eee1-4071-b845-632c74a7a3b1 service nova] Creating event network-vif-plugged:94bc6936-1b5d-4a19-89d7-83fb58d05514 for instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb on hv-cinder-85604 Sep 06 11:51:42.708235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-7743aefc-a951-4bd7-8cd0-5bab6b61c2fe req-8c5e4ffa-eee1-4071-b845-632c74a7a3b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040887 Sep 06 11:51:42.710603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 167/303] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:42.715839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3abc3256-436e-4a40-90af-721fc4765d08 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.164231 Sep 06 11:51:42.717146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 137/304] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Sep 6 11:51:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:51:42.917085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:42.917893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:42.924537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.925029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.925463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:42.926202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:42.926655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:42.927079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.282410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:43.283697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:43.291826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.291938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.292304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.292990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.293602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.294044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.321216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:43.330765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37c1bc71-7164-4d39-9351-fbbadabdd2ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1516 microversion: 2.1 time: 0.419690 Sep 06 11:51:43.331742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 168/305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:42 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:43.359798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:43.364223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:43.372185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.373236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.374099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.374961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.375562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.377458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.473511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'flavor' on Instance uuid 276be2d2-5442-4aa5-9eda-a25444b0bfb0 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:51:43.517908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:43.527877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cd2d66bd-33e7-4c78-b65a-10be93b8dc30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.250122 Sep 06 11:51:43.528641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 138/306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:43.575283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:43.576222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:43.583680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.584609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.585213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.586102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.586710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.587284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.640194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49a8fd00-d751-4834-8127-60a412f7af0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0/action" status: 200 len: 32 microversion: 2.1 time: 0.284980 Sep 06 11:51:43.642107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 169/307] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:51:43 2022] POST /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0/action => generated 32 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:51:43.654710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:43.655770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:43.664982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.665740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.666652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.667866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.668484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.669264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.763158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:43.772348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91b949cc-e12d-45d1-99eb-1858a9b0b31a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.201936 Sep 06 11:51:43.773524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 139/308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:43.804004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:43.804694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:43.818909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.819644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.821343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:43.825904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:43.826384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:43.826958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:44.011017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:44.031467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:44.039407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-265a43c8-ad15-42c6-a0c1-174f76c96b8b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.264349 Sep 06 11:51:44.040252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 140/309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:43 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:44.041689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1895f841-bf4d-4274-bcec-474aebcad00c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.393122 Sep 06 11:51:44.043102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 170/310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:43 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:44.542952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-e1f12024-fc8c-4639-9adf-7df324dc3623 req-e9c68485-088d-4dac-a4cb-36caec25ae57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:44.551183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:44.551806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:44.561787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:44.565230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:44.565713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:44.566449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:44.566945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:44.567356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:44.593405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-e1f12024-fc8c-4639-9adf-7df324dc3623 req-e9c68485-088d-4dac-a4cb-36caec25ae57 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:44.594275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-e1f12024-fc8c-4639-9adf-7df324dc3623 req-e9c68485-088d-4dac-a4cb-36caec25ae57 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:44.596319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-e1f12024-fc8c-4639-9adf-7df324dc3623 req-e9c68485-088d-4dac-a4cb-36caec25ae57 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:44.637468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-e1f12024-fc8c-4639-9adf-7df324dc3623 req-e9c68485-088d-4dac-a4cb-36caec25ae57 service nova] Creating event network-changed:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 11:51:44.644933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-e1f12024-fc8c-4639-9adf-7df324dc3623 req-e9c68485-088d-4dac-a4cb-36caec25ae57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105370 Sep 06 11:51:44.647698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 141/311] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:44.762522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:44.771213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27bac922-eaa3-4f39-86f7-808bf62953b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.223861 Sep 06 11:51:44.779768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 171/312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:44.796760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:44.797569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:44.804023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:44.804580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:44.805080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:44.805878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:44.806584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:44.807116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:44.978176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:44.987370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8bf4c4af-bfbf-4da3-99ca-ccc018b2c549 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.195119 Sep 06 11:51:44.988394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 142/313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:45.063914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:45.064581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:45.081957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:45.081957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:45.081957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:45.081957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:45.082285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:45.082285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:45.112945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:45.120935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:45.135879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:45.136818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:45.137485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:45.138451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:45.139083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:45.139859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:45.238405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:45.247539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0968f915-ac98-4083-a1ca-e2294d09433d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.187716 Sep 06 11:51:45.248129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 172/314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:45 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:45.317713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:45.326263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7d1688b-bb07-4062-beb3-15a6ee7d1b70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.251484 Sep 06 11:51:45.326866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 143/315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:45 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:45.794427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:45.795101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:45.801199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:45.801811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:45.802248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:45.803211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:45.803656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:45.804072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:45.946435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:45.954314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-31dad768-9f91-4d7e-ac01-ca427217d02d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.163689 Sep 06 11:51:45.954978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 173/316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:46.011796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:46.012398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:46.018609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.019076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.019950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.020329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.020788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.021261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.157264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:46.166038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-606fb877-1234-431b-8879-94b24c7fdd01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1363 microversion: 2.1 time: 0.158126 Sep 06 11:51:46.166607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 144/317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:46.271884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:46.272502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:46.278458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.278940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.279375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.280060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.280513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.280934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.285021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:46.350653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:46.351269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:46.357276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.358365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.358365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.358922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.359373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.359795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.424297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:46.432798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e30766f-994b-43c9-ac03-e265341abe3d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.165339 Sep 06 11:51:46.433511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 174/318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:46 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:46.498026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:46.505695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9cf37cb8-70d3-424a-9a40-d52cda5e6e18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.159629 Sep 06 11:51:46.506900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 145/319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:46 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:46.978520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:46.979125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:46.985058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.985533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.985989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:46.986695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:46.987140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:46.987588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.123683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:47.132528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b518058a-91eb-44ea-beeb-2adf4d98194d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.158217 Sep 06 11:51:47.133376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 175/320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:47.190218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:47.190830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:47.198369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.198896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.199405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.200332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.200884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.201430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.206367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:47.352508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:47.360083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4799503e-7a35-41c7-88a5-f0f69fc50a0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1549 microversion: 2.1 time: 0.173712 Sep 06 11:51:47.360662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 146/321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:47.384392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:47.384878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:47.390995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.391640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.392070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.392755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.393199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.393696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.457694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:47.458326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:47.466713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.467370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.467886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.468760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.469410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.470131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.610436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:47.618579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f10d6a55-a0a2-4d2c-a43b-790eb3f9f666 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.238716 Sep 06 11:51:47.619179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 176/322] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 11:51:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-interface => generated 285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:47.620219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-75ebeebc-e98b-4f96-bf1b-0baee62f22c3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.166428 Sep 06 11:51:47.621108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 147/323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:47 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:47.624268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:47.625020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:47.643221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.643709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.644147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.644853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:47.645307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:47.645768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:47.794234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:47.803572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-68722120-e893-4634-810c-80695d0d40cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.182423 Sep 06 11:51:47.804861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 177/324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:47 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:48.156529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:48.157289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:48.163802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:48.164297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:48.164731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:48.165447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:48.165961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:48.166389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:48.585338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:48.594708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f8cd52fc-cc1d-4803-8f10-1dc7b3d27338 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1367 microversion: 2.1 time: 0.442014 Sep 06 11:51:48.595760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 148/325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1367 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:48.645163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:48.645844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:48.649413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:48.654938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:48.655506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:48.656047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:48.657101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:48.657589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:48.658130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:48.826425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:48.828678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:48.829421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:48.836397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a25a52e-b790-4504-93a3-a63afde05f16 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.195148 Sep 06 11:51:48.849706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 178/326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:48 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:48.850019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:48.850019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:48.850019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:48.850019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:48.850572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:48.850572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.090799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:49.098759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-61131113-0a6f-48f9-8635-ebf9a61b8dc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.274101 Sep 06 11:51:49.100646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 149/327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:48 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:49.178572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-de79084e-711c-4786-89c6-b5264ef6fdfd req-30ba6a84-a67f-4b77-9ac1-14e1d0a52963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2942181c-63de-4194-946d-9d8ca5c4b4a3", "tag": "429d5db2-cf15-4c0a-adeb-c7310ca25fc9"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:49.196828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-de79084e-711c-4786-89c6-b5264ef6fdfd req-30ba6a84-a67f-4b77-9ac1-14e1d0a52963 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.199462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-de79084e-711c-4786-89c6-b5264ef6fdfd req-30ba6a84-a67f-4b77-9ac1-14e1d0a52963 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.199821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-de79084e-711c-4786-89c6-b5264ef6fdfd req-30ba6a84-a67f-4b77-9ac1-14e1d0a52963 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.214113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-de79084e-711c-4786-89c6-b5264ef6fdfd req-30ba6a84-a67f-4b77-9ac1-14e1d0a52963 service nova] Creating event network-changed:429d5db2-cf15-4c0a-adeb-c7310ca25fc9 for instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 on hv-cinder-85604 Sep 06 11:51:49.219774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-de79084e-711c-4786-89c6-b5264ef6fdfd req-30ba6a84-a67f-4b77-9ac1-14e1d0a52963 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044705 Sep 06 11:51:49.220539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 179/328] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:49.619470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:49.620097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:49.626838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.627382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.627905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.628563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.629020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.629440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.775270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:49.784120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-84c205bc-1336-4a1d-b0f7-b97fa04e1897 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1558 microversion: 2.1 time: 0.170024 Sep 06 11:51:49.784775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 150/329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:49.809172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:49.809780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:49.816286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.816874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.817396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.818262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.818722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.819152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.863945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:49.864667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:49.871048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.871530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.871971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.873290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:49.873822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:49.874248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:49.908634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef12c97b-2e3d-494d-b239-85c1c07d168d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103638 Sep 06 11:51:49.909226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 180/330] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 11:51:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:50.044954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:50.055347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f50646c-7e3c-4a93-b57b-8dcb7581b53d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.195165 Sep 06 11:51:50.056479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 151/331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:49 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:50.122880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:50.123491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:50.129842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:50.130455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:50.131288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:50.133208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:50.133545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:50.134275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:50.487534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:50.495868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9cf4dd1c-04da-4177-af32-c710a58c3bf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.376823 Sep 06 11:51:50.496442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 181/332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:50 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:51.080660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:51.081954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:51.085027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:51.092173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:51.092683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:51.093122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:51.093903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:51.094361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:51.094786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:51.117933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-2165d9fc-b366-4a5c-8579-6a8ff79aceac req-eec061b7-d170-4dd7-9019-7009fb51f49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb205f-f79a-4c52-b0e3-190868135839", "tag": "f1f133bf-a5b0-4fa4-a620-a0a7431dee95"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:51.127851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2165d9fc-b366-4a5c-8579-6a8ff79aceac req-eec061b7-d170-4dd7-9019-7009fb51f49b service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:51.128589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2165d9fc-b366-4a5c-8579-6a8ff79aceac req-eec061b7-d170-4dd7-9019-7009fb51f49b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:51.129011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2165d9fc-b366-4a5c-8579-6a8ff79aceac req-eec061b7-d170-4dd7-9019-7009fb51f49b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:51.142457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-2165d9fc-b366-4a5c-8579-6a8ff79aceac req-eec061b7-d170-4dd7-9019-7009fb51f49b service nova] Creating event network-changed:f1f133bf-a5b0-4fa4-a620-a0a7431dee95 for instance 23cb205f-f79a-4c52-b0e3-190868135839 on hv-cinder-85604 Sep 06 11:51:51.149756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-2165d9fc-b366-4a5c-8579-6a8ff79aceac req-eec061b7-d170-4dd7-9019-7009fb51f49b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036198 Sep 06 11:51:51.150914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 182/333] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:51.267388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:51.278987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7349a2f-6e82-4e15-b1ba-8e6e2865ea09 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.203303 Sep 06 11:51:51.282064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 152/334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:51 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:51.524167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:51.524947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:51.535446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:51.541438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:51.543852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:51.547267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:51.551642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:51.552329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:51.810667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:51.821054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-637784aa-a77c-481b-9fff-6bbf280567f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.305856 Sep 06 11:51:51.833673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 183/335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:51 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:52.303118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:52.304500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:52.313407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:52.314135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:52.314992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:52.315953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:52.316415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:52.316852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:52.457446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:52.465758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4d514904-f445-4a1b-89ac-d8463578ac11 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1312 microversion: 2.1 time: 0.167232 Sep 06 11:51:52.466327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 153/336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:52 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:52.844548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:52.845148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:52.852185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:52.852671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:52.853106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:52.853836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:52.854291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:52.854710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:53.048285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:53.058856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-021948e6-92a6-45e7-94a4-662a761862d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.218125 Sep 06 11:51:53.059525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 184/337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:52 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:53.488844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:53.491312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:53.498614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:53.499381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:53.500075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:53.500960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:53.501608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:53.502370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:53.771511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:53.779859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41cf1448-4ed9-4c0b-950f-884bd1a04382 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1498 microversion: 2.1 time: 0.295333 Sep 06 11:51:53.780444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 154/338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:53 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1498 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:54.083676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:54.085287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:54.092556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:54.093300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:54.094386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:54.095433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:54.096119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:54.096745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:54.264188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:54.272925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d619e6c4-15d0-458f-8d76-45f18895ffcd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.193275 Sep 06 11:51:54.273493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 185/339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:54 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:55.297071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:55.297792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:55.305017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:55.305522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:55.305986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:55.317095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:55.317685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:55.318921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:55.460409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:55.469172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1beee605-cf89-4a70-b70c-3c1bf43b1881 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.176509 Sep 06 11:51:55.469866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 155/340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:55 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:56.310206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe546ebb-0a37-4484-9351-fd7a143c9ddf"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:51:56.312513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:56.318625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:56.319121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:56.319576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:56.320226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:56.322490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:56.322490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:56.492882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:56.493402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:56.500936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:56.501443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:56.501903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:56.502806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:56.503425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:56.503906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:56.663240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:56.671706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d8e6e62b-f29e-4d12-b4f5-47dfccb89985 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.182940 Sep 06 11:51:56.672281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 156/341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:56 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:51:56.753225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-17e97312-a8f6-4913-9c0c-814a1af0a5f2 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "POST /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446715 Sep 06 11:51:56.753980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 186/342] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:51:56 2022] POST /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:51:57.696387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:57.697818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:57.716957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:57.716957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:57.716957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:57.717253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:57.717627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:57.718149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:57.861741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:57.871173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc0e4c60-823a-484a-a7bf-a90d4129107a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.179350 Sep 06 11:51:57.871763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 157/343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:57 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:51:58.898034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:51:58.898735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:51:58.904882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:58.905362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:58.905826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:58.906513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:51:58.906961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:51:58.907376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:51:59.041662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:51:59.049315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-51fff529-45ae-4071-acc1-a7c7198a339b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.156995 Sep 06 11:51:59.049916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 187/344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:51:58 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:00.078182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:00.078802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:00.086707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:00.087190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:00.087624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:00.088323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:00.088782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:00.089240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:00.229596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:00.237749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-58b94221-05ae-4fa2-8383-d25d70a616e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.164159 Sep 06 11:52:00.238263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 158/345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:00 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:01.260641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:01.261307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:01.268211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:01.268703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:01.269143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:01.269872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:01.270331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:01.270755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:01.418969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:01.426864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1023a26-a760-43d3-883e-b071de8ff583 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.170307 Sep 06 11:52:01.427441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 188/346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:01 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:02.451486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:02.452095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:02.458178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:02.458654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:02.459091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:02.459767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:02.460219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:02.460643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:02.593068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:02.600634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6a971970-033e-46b8-b2dd-16dd9d5f0190 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.152994 Sep 06 11:52:02.601212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 159/347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:02 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:03.630048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:03.631195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:03.643489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:03.644369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:03.645057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:03.646308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:03.647154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:03.647930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:03.800769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:03.811020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ac3d95f-a532-4b4c-b0eb-f5398602d973 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.189286 Sep 06 11:52:03.811601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 189/348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:03 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:04.836619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:04.837226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:04.844542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:04.845028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:04.845476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:04.846200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:04.846651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:04.847434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:05.008087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:05.017014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ef938b9-7759-4e76-8de1-38df90897daf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.184334 Sep 06 11:52:05.017513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 160/349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:04 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:06.042359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:06.042884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:06.049718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:06.050066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:06.050486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:06.051186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:06.051641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:06.052066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:06.247595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:06.256290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73f66716-41fc-47d0-a76c-ad3ba0316ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.218733 Sep 06 11:52:06.256871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 190/350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:06 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:07.279946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:07.281176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:07.287983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:07.288465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:07.289676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:07.290522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:07.291002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:07.291593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:07.424037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:07.432937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d562de9-d225-432a-a4dc-8a1ed77d12a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.156817 Sep 06 11:52:07.433782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 161/351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:07 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:07.544307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:07.544889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:07.551531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:07.552263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:07.552880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:07.553892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:07.554992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:07.555573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:07.579446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:07.586805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:52:07.676138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d91f84fa-db70-4a30-bc4c-404eb31fb66d tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 204 len: 0 microversion: 2.1 time: 0.136223 Sep 06 11:52:07.677195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 191/352] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 11:52:07 2022] DELETE /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:52:07.686850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:07.687489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:07.697874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:07.697874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:07.697874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:07.698553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:07.699427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:07.699577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:07.841550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:07.845157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:07.850812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc52a106-0d8b-457f-a220-6dd611b1d52b tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1550 microversion: 2.1 time: 0.167884 Sep 06 11:52:07.851428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 162/353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:07 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:08.457256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:08.457985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:08.465348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:08.465910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:08.466357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:08.467525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:08.467991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:08.468421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:08.610743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:08.618549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-46338df7-4e5d-4e53-b5f1-da6d2e898b9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.165533 Sep 06 11:52:08.619120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 192/354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:08 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:08.874322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:08.874932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:08.881237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:08.881736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:08.882169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:08.883343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:08.883804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:08.884221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:09.016769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:09.025477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-26ccb832-cb0f-457c-b452-ea7f5408b505 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1550 microversion: 2.1 time: 0.154987 Sep 06 11:52:09.026085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 163/355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:08 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:09.642436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:09.642981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:09.650286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:09.650797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:09.651217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:09.651914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:09.652368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:09.652795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:09.783258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:09.791742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0632cae5-b6c9-41ac-9f22-20d450220cb3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.153700 Sep 06 11:52:09.792311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 193/356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:09 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:10.049508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:10.050161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:10.056148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.056635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.057075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.057807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.058348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.058688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.193714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:10.202660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1118ebfb-714c-4ab2-983f-180cf21a3524 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1550 microversion: 2.1 time: 0.157297 Sep 06 11:52:10.203238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 164/357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:10 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:10.814932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:10.815544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:10.823327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.824150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.825184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.826073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:10.826073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:10.826437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:10.975305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:10.983702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e5ca1271-07b8-4299-b9c0-df2022c3b066 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.172653 Sep 06 11:52:10.984378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 194/358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:10 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:11.227435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:11.228116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:11.241689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.242521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.243375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.244187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.244638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.245050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.543966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:11.552151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-73be551b-477f-4354-86d8-1d9d0661ad69 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1550 microversion: 2.1 time: 0.329422 Sep 06 11:52:11.566286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 165/359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:11 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1550 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:11.900652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-df04a22a-c02f-40f6-824e-43b7904a47a9 req-e2e5c24e-1182-44f7-90f1-017c14279c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0412c-b404-44d6-8460-ba2be7a0ccdb", "name": "network-vif-deleted", "tag": "94bc6936-1b5d-4a19-89d7-83fb58d05514"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:11.912142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-df04a22a-c02f-40f6-824e-43b7904a47a9 req-e2e5c24e-1182-44f7-90f1-017c14279c3f service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:11.912625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-df04a22a-c02f-40f6-824e-43b7904a47a9 req-e2e5c24e-1182-44f7-90f1-017c14279c3f service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:11.913053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-df04a22a-c02f-40f6-824e-43b7904a47a9 req-e2e5c24e-1182-44f7-90f1-017c14279c3f service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:11.925223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-df04a22a-c02f-40f6-824e-43b7904a47a9 req-e2e5c24e-1182-44f7-90f1-017c14279c3f service nova] Creating event network-vif-deleted:94bc6936-1b5d-4a19-89d7-83fb58d05514 for instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb on hv-cinder-85604 Sep 06 11:52:11.931167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-df04a22a-c02f-40f6-824e-43b7904a47a9 req-e2e5c24e-1182-44f7-90f1-017c14279c3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037070 Sep 06 11:52:11.932151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 195/360] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:12.008498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:12.009104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:12.015095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.015831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.016261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:12.016946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.017401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.017857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:12.148182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:12.156350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-47d8cf3b-74db-46fa-9a4d-03bc14c4d626 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.152360 Sep 06 11:52:12.156923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 166/361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:12 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:12.579149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:12.580131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:12.587921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.588414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.588851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:12.589558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.590039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.590463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:12.627102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:12.627590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:12.628079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:12.628529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lazy-loading 'fault' on Instance uuid 20e0412c-b404-44d6-8460-ba2be7a0ccdb {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:52:12.675932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd2f6cc960242e2b01df2caf0aba2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df65a60541a8492a912cab1a8f243253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:12.684858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b063dbde-ad03-45c9-b29c-91082ca83cc5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 200 len: 1348 microversion: 2.1 time: 0.110147 Sep 06 11:52:12.700642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 196/362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:12 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:13.181083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:13.182504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:13.191350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:13.192409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:13.193630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.195370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:13.196539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:13.197539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.356441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:13.366033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-990c1ecc-cbab-43dd-9f77-ad22891445c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.190206 Sep 06 11:52:13.366759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 167/363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:13 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:13.709189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:13.710369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:13.717989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:13.718477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:13.718906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.719605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:13.720053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:13.720472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.737225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] HTTP exception thrown: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Request method failure captured: Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb HTTP/1.1 Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP5Y9OXUjR2puDvsXWTFVdtV9UlU3do1D_mwskE0NDi6CndN6GCqfKhrTZyYdtTdpmnvMPK4sIJVVZB02Igbl-DKquFZNa54GsKW6YoNHQ42UAjxegNRVBbQp9VoA6Cw_rZ5N6SReLxY4kGlqHop_n7w38lkNcvWddbe4Benn9GSYs Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:52:13.742892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df65a60541a8492a912cab1a8f243253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df65a60541a8492a912cab1a8f243253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}] Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 8dd2f6cc960242e2b01df2caf0aba2cd Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.744491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '20e0412c-b404-44d6-8460-ba2be7a0ccdb'} Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:52:13.745346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.747914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Returning 404 to user: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:52:13.747914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-699249c2-af17-4dad-bd9d-b66c2d651bb5 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 404 len: 111 microversion: 2.1 time: 0.039603 Sep 06 11:52:13.747914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 197/364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:13 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:13.872166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:13.874406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:13.880425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:13.880909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:13.881345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.882139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:13.883127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:13.883585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:13.898870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] HTTP exception thrown: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Request method failure captured: Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb/os-volume_attachments HTTP/1.1 Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP5Y9OXUjR2puDvsXWTFVdtV9UlU3do1D_mwskE0NDi6CndN6GCqfKhrTZyYdtTdpmnvMPK4sIJVVZB02Igbl-DKquFZNa54GsKW6YoNHQ42UAjxegNRVBbQp9VoA6Cw_rZ5N6SReLxY4kGlqHop_n7w38lkNcvWddbe4Benn9GSYs Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 11:52:13.903718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df65a60541a8492a912cab1a8f243253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df65a60541a8492a912cab1a8f243253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}] Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 8dd2f6cc960242e2b01df2caf0aba2cd Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.905102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'server_id': '20e0412c-b404-44d6-8460-ba2be7a0ccdb'} Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:52:13.905977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:13.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:13.908526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Returning 404 to user: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:52:13.908526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6470903d-7aff-4a8f-8ff7-9c62b9c81e96 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036942 Sep 06 11:52:13.908526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 168/365] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:52:13 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:14.394389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:14.395012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:14.402064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:14.402557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:14.402999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:14.403701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:14.404161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:14.404816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:14.826051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:14.839995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37789724-7bf2-4974-a10f-4036a93e4c7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.450759 Sep 06 11:52:14.839995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 198/366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:14 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:15.862857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:15.863400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:15.871314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:15.871691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:15.872132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:15.872821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:15.873287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:15.873923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.039466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:16.047879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c317ed47-8e69-4425-a841-e342f361bd25 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.190357 Sep 06 11:52:16.048475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 169/367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:15 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:16.215018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:16.215536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:16.222038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:16.222524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:16.222956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.223646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:16.224094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:16.224515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.238618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] HTTP exception thrown: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Request method failure captured: Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb HTTP/1.1 Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP5Y9OXUjR2puDvsXWTFVdtV9UlU3do1D_mwskE0NDi6CndN6GCqfKhrTZyYdtTdpmnvMPK4sIJVVZB02Igbl-DKquFZNa54GsKW6YoNHQ42UAjxegNRVBbQp9VoA6Cw_rZ5N6SReLxY4kGlqHop_n7w38lkNcvWddbe4Benn9GSYs Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:52:16.240216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df65a60541a8492a912cab1a8f243253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df65a60541a8492a912cab1a8f243253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}] Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 8dd2f6cc960242e2b01df2caf0aba2cd Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.241860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '20e0412c-b404-44d6-8460-ba2be7a0ccdb'} Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:52:16.242667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.244218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.245629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Returning 404 to user: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:52:16.245629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58eb9923-b1b9-4b54-bc36-d824189c1c82 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "DELETE /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 404 len: 111 microversion: 2.1 time: 0.031644 Sep 06 11:52:16.245629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 199/368] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 11:52:16 2022] DELETE /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:16.250809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:16.251421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] [instance: 20e0412c-b404-44d6-8460-ba2be7a0ccdb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:16.257957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:16.259057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:16.259490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.260196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:16.260642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:16.261058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:16.276745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] HTTP exception thrown: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Request method failure captured: Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb HTTP/1.1 Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP5Y9OXUjR2puDvsXWTFVdtV9UlU3do1D_mwskE0NDi6CndN6GCqfKhrTZyYdtTdpmnvMPK4sIJVVZB02Igbl-DKquFZNa54GsKW6YoNHQ42UAjxegNRVBbQp9VoA6Cw_rZ5N6SReLxY4kGlqHop_n7w38lkNcvWddbe4Benn9GSYs Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 11:52:16.278964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df65a60541a8492a912cab1a8f243253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df65a60541a8492a912cab1a8f243253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df65a60541a8492a912cab1a8f243253"}]}] Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: df65a60541a8492a912cab1a8f243253 Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-DeleteServersTestJSON-1009194075 Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 8dd2f6cc960242e2b01df2caf0aba2cd Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-DeleteServersTestJSON-1009194075-project Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.280358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '20e0412c-b404-44d6-8460-ba2be7a0ccdb'} Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:52:16.281238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. Sep 06 11:52:16.282620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:52:16.283784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] Returning 404 to user: Instance 20e0412c-b404-44d6-8460-ba2be7a0ccdb could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:52:16.283784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2d56ff70-3e97-45f2-995d-551578f7ecb3 tempest-DeleteServersTestJSON-1009194075 tempest-DeleteServersTestJSON-1009194075-project] 10.222.0.18 "GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb" status: 404 len: 111 microversion: 2.1 time: 0.033527 Sep 06 11:52:16.283784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 170/369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:16 2022] GET /compute/v2.1/servers/20e0412c-b404-44d6-8460-ba2be7a0ccdb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:52:17.073199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:17.073874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:17.080547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:17.081044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:17.081488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:17.082235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:17.082702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:17.083272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:17.331188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:17.340904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1c0875ad-c3ff-42e1-bc39-c6d5b942ccb5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.273944 Sep 06 11:52:17.341924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 200/370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:17 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:18.365569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:18.367453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:18.375427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:18.375921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:18.376345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:18.377223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:18.377719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:18.378147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:18.575634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:18.584029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ce48014c-b3db-41d6-bdd5-b2ffd49fcbc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.223441 Sep 06 11:52:18.585726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 171/371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:18 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:19.608370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:19.609438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:19.620675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:19.625052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:19.627194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:19.628123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:19.630235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:19.630945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:19.635143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:19.942353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:19.966911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b23957f9-6033-4d5e-8754-0a2e3004e0f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.362821 Sep 06 11:52:19.967503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 201/372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:19 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:21.005855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:21.007034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:21.022175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:21.023391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:21.024668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:21.025516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:21.026279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:21.027004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:21.295538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:21.304831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-315f70e6-76d7-442a-9a52-1655f507c564 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.311470 Sep 06 11:52:21.319362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 172/373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:20 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:22.329819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:22.330523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:22.338763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:22.339760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:22.340258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:22.341601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:22.342249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:22.342777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:22.590874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:22.613685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b2ec10b4-9ccc-4389-95a8-edf0a6b4de42 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.288553 Sep 06 11:52:22.629833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 202/374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:22 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:23.666786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:23.667415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:23.675725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=41 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:23.678750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:23.679500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:23.679951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:23.680683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:23.681318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:23.681781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:24.066716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:24.082959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d672f6f0-309f-486d-a10e-b01db8f02dd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.419394 Sep 06 11:52:24.090191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 173/375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:23 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:25.108321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:25.109745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:25.121791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:25.124707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:25.127311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:25.128491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:25.129198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:25.142033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:25.498383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:25.513349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e916d3a-629d-470a-897e-b5b1b5413ceb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.408499 Sep 06 11:52:25.520467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 203/376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:25 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:26.543059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:26.543746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:26.560457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:26.561243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:26.564037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:26.564703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:26.565432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:26.567310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:26.988153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:26.998227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1ccfc3e2-0814-4b52-9351-3ead1e0fed31 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.460862 Sep 06 11:52:27.004768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 174/377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:26 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:28.034766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:28.036364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:28.145727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:28.148295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.070s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:28.149239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:28.152477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:28.153317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:28.154735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:28.614060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:28.626069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2048b06b-c01a-47f2-8ece-0eff0b47c3fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.603959 Sep 06 11:52:28.642550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 204/378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:28 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:29.686063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:29.691045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:29.718230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:29.718743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:29.719194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:29.719914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:29.726985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:29.730893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:29.991998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:30.002594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-148c9963-2b3e-42ff-8069-b3526a1cb2f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.346335 Sep 06 11:52:30.003560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 175/379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:29 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:31.031413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:31.032020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:31.056206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:31.056713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:31.057146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:31.058094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:31.058708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:31.059288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:31.451770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:31.464025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b57294d4-4144-4b45-83e4-bb02cdcee00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.435860 Sep 06 11:52:31.464646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 205/380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:31 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:32.489782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:32.490926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:32.498682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.499173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.499805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.500550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:32.501241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:32.501680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:32.633610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-809701098", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "networks": [{"uuid": "cd8b7a53-a53d-4aec-8785-942e20afceca"}]}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:32.732308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] validate_networks() for [('cd8b7a53-a53d-4aec-8785-942e20afceca', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:52:33.165860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:33.187846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ade3a078-22d3-435c-ab03-827b49342413 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.702597 Sep 06 11:52:33.191461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 176/381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:32 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:33.471326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:52:33.472058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:52:33.472892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:52:33.473678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:52:33.474504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:52:33.511120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:33.521381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:33.522977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:33.523996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:33.524609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:33.525319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:33.549195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Getting quotas for project 474d58de54cb4c44ab3885e9a2943a0c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:52:33.554712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Getting quotas for user a597decac02943339b9909d41020d8c7 and project 474d58de54cb4c44ab3885e9a2943a0c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:52:33.570719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:52:33.573489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:52:33.675312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5e88185d-e3d2-4abb-a03c-99272a274532 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046742 Sep 06 11:52:33.676992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 206/382] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:52:33.689580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b3ebedaa-e71f-41e7-9190-f49728bd65e5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:33.690390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b3ebedaa-e71f-41e7-9190-f49728bd65e5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:33.928076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b3ebedaa-e71f-41e7-9190-f49728bd65e5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:33.940378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b3ebedaa-e71f-41e7-9190-f49728bd65e5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1213 microversion: 2.1 time: 0.255898 Sep 06 11:52:33.943095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 177/383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:33 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:34.215476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:34.220878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:34.231482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:34.232002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:34.232563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:34.233185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:34.233697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:34.234114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:34.607538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:34.657944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-213130d2-b20e-432b-974d-ca16f45dd20b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.445156 Sep 06 11:52:34.659090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 207/384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:34 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:34.974419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:34.976902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:34.988913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:34.989524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:34.990237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:34.992018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:34.992770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:34.993407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.127946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:35.139566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-124c0826-5924-44d4-85c6-ea0327cce59b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.173163 Sep 06 11:52:35.140946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 178/385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:34 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:35.685933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:35.687373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:35.695551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.696273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.697023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.697964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:35.698585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:35.699172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:35.864387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:35.872612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:35.883439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aa3450f4-8921-4a0e-bcbf-f867e88b179c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.202258 Sep 06 11:52:35.885430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 208/386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:35 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:36.164089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:36.164874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:36.172361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:36.173288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:36.174111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:36.175079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:36.175776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:36.176428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:36.297099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:36.314134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7235d3e4-cfdc-4c7d-995d-81729ff1012f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.153859 Sep 06 11:52:36.315839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 179/387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:36 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:36.911214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:36.911927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:36.926042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:36.929036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:36.929869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:36.931364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:36.932161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:36.932929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:37.174780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:37.186663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99b7e55c-6802-45c7-95ba-6e5e8f8b651a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.282218 Sep 06 11:52:37.188018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 209/388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:36 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:37.341920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:37.342700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:37.349437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:37.349958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:37.351032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:37.351824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:37.352275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:37.352692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:37.447989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:37.457978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a3a36b99-7402-4905-8259-2c39f329b975 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.120680 Sep 06 11:52:37.458570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 180/389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:37 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:38.216906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:38.219456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:38.309108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.309608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.310087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.310818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.311278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.311710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.499135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:38.499760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:38.504721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:38.516056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.516662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.524368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.525350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:38.525981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:38.526505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:38.536146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6008df84-29f3-4137-8404-e2608b93fe7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.327281 Sep 06 11:52:38.546746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 210/390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:38 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:38.628032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:38.632291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:38.640499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-686ad68b-c960-49c2-938f-730a387fd9bd tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.145002 Sep 06 11:52:38.641135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 181/391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:38 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:39.563704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:39.564341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:39.571835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.572343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.572790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.573498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.573985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.574605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.664908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:39.666958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:39.674278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.675282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.676187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.678175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:39.679777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:39.680462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:39.752082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:39.763810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d76f622-0643-437d-9f19-9a3cc6aa1fc4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.103798 Sep 06 11:52:39.764933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 182/392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:39 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:39.780301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:39.792156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f9b10051-3d8e-41d9-a4a6-a2dc65f466d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.232576 Sep 06 11:52:39.793001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 211/393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:39 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:40.795301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:40.802613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:40.827227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:40.829577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:40.845817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:40.851475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:40.852625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:40.854567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:40.864431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:40.868041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:40.872044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:40.874798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:40.878663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:40.880226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:40.885401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:40.887349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:41.172362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:41.212708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-052a1a64-114c-4f2e-adb8-7eb42ce4786a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.426461 Sep 06 11:52:41.218289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 183/394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:40 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:41.375990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:41.384340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8cce2a91-1f4d-4e2e-9a8e-6407a81996f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.570208 Sep 06 11:52:41.393575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 212/395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:40 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:42.243624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:42.245045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:42.266941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:42.270757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:42.271456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:42.273102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:42.274831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:42.277675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:42.355793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:42.364175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34e664bf-9fe5-413e-9793-bcfb752445be tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.125205 Sep 06 11:52:42.368490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 184/396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:42 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:42.424396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:42.426316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:42.443122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:42.443901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:42.444572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:42.445517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:42.446241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:42.448724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:42.614164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:42.621983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37bc4821-142f-4b4a-bf2b-f420e0a30008 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.203471 Sep 06 11:52:42.622567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 213/397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:42 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:43.393063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:43.394496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:43.403445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:43.404642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:43.406117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:43.406855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:43.407322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:43.407964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:43.489767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:43.498579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c8549458-9778-4781-856c-8c81e1a45f1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.109900 Sep 06 11:52:43.499822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 185/398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:43 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:43.648232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:43.649613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:43.653237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:43.654117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=6 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:43.659230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:43.660133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:43.660705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:43.661720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:43.662360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:43.663897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:43.815724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:43.824743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1fc5870d-601d-4da1-aeaf-d16e3d632452 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.181035 Sep 06 11:52:43.825715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 214/399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:43 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:44.527127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:44.527127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:44.531348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:44.534241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:44.534737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:44.535175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:44.535890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:44.536349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:44.536781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:44.647493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:44.666809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d92b71c0-a812-475d-945c-82bca126687c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.145023 Sep 06 11:52:44.674088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 186/400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:44 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:44.852779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:44.853361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:44.860832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:44.861619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:44.862104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:44.862824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:44.863293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:44.863867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:45.032020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:45.041279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4fd542ec-b4eb-4f19-96c6-d8780c550f3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.192986 Sep 06 11:52:45.042493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 215/401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:44 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:45.696608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:45.697212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:45.703642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:45.704126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:45.704830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:45.705898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:45.706352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:45.706773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:45.774545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:45.783001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ea36d806-6956-4c31-a770-1a6b1344fa8e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.091300 Sep 06 11:52:45.785132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 187/402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:45 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:46.066357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:46.066357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:46.072376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:46.073206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:46.073904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:46.074928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:46.075408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:46.075850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:46.240321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:46.249235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09e107cc-1d71-4de7-a69a-f8619fc2fb0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.188439 Sep 06 11:52:46.250166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 216/403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:46 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:46.773437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-01d7eb69-278e-4fad-a582-8e82d507c7e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'create', calling method: .version_select at 0x7f97f50f09d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1056706380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOa2bXJxqzN17bYKRtjfoq064XdXqg+FNjuN222A6hYjFBi5ORz6IThNLBwSv3EIsrRhMyAGbiXW7gNq0C65LqGR4PPU9+q9c79vWGqMbc7aSJwbXaD3jWQOUGQiYzyTQ=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:46.790161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-01d7eb69-278e-4fad-a582-8e82d507c7e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Getting quotas for project 474249b02d3140b6bae6ec312cdd142f. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:52:46.794032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-01d7eb69-278e-4fad-a582-8e82d507c7e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Getting quotas for user 683b8a5c6d9048fe871fc563c9e45ca9 and project 474249b02d3140b6bae6ec312cdd142f. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:52:46.807274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:46.807899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:46.815647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:46.816083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:46.816260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-01d7eb69-278e-4fad-a582-8e82d507c7e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047351 Sep 06 11:52:46.816536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:46.817080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 188/404] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 11:52:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:52:46.817236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:46.817775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:46.818207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:46.879920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-878326142", "imageRef": "d1c79217-3e50-42ed-8655-d17c53797e64", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1056706380", "networks": [{"uuid": "9532d9be-d3d4-40d8-ab7b-9e1ceece912c"}]}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:52:46.887241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:46.895268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4792c20c-e5a4-4655-9239-06b8c9a36dbc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.092931 Sep 06 11:52:46.895919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 217/405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:46 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:46.935541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] validate_networks() for [('9532d9be-d3d4-40d8-ab7b-9e1ceece912c', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:52:47.274528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:47.275136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:47.281537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.282046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.282578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.283166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.284584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.284584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.334980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:52:47.335471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:52:47.335997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:52:47.336547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:52:47.337011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:52:47.345960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.346512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.346946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.347666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.348105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.348533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.366167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Getting quotas for project 474249b02d3140b6bae6ec312cdd142f. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:52:47.370465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Getting quotas for user 683b8a5c6d9048fe871fc563c9e45ca9 and project 474249b02d3140b6bae6ec312cdd142f. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:52:47.382079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:52:47.384293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1c79217-3e50-42ed-8655-d17c53797e64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:52:47.420707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:47.428885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5239f416-040a-432f-b503-0892a238c5f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.158823 Sep 06 11:52:47.429361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 218/406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:47 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:47.434138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e997227c-dfe7-4e78-bcea-f3f621742831 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557948 Sep 06 11:52:47.440508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 189/407] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:52:47.446181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-22aab58a-7524-4c72-bf01-025e364c9a8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:47.446877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-22aab58a-7524-4c72-bf01-025e364c9a8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:47.504738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-22aab58a-7524-4c72-bf01-025e364c9a8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:47.512336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-22aab58a-7524-4c72-bf01-025e364c9a8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1258 microversion: 2.1 time: 0.070370 Sep 06 11:52:47.512916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 219/408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:47.919375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:47.919985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:47.926723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.927181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.927613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.928829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:47.929282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:47.929725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:47.991296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:47.998822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b71ebf5-baf7-413d-b414-d3107b025aa0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.083926 Sep 06 11:52:47.999386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 190/409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:47 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:48.451936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:48.452531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:48.460476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:48.461008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:48.461448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:48.462221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:48.462682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:48.463116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:48.535559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:48.536186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:48.544131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:48.544623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:48.545056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:48.545789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:48.546243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:48.546664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:48.596408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:48.605036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8d318448-685e-47a6-87a6-a9359f2070e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.156984 Sep 06 11:52:48.605612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 220/410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:48 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:48.624494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:48.633465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6462038d-7015-465b-952e-00172bacf51f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.101779 Sep 06 11:52:48.634400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 191/411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:49.024495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:49.025149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:49.031534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.032025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.032463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.033164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.033623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.034076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.097413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:49.105666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2bb6139b-19cc-4ead-836b-6b89ceb9b076 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.085736 Sep 06 11:52:49.109852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 221/412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:49 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:49.629079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:49.629664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:49.636656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.637147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.637587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.638339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.638806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.639227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.665457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:49.666124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:49.673354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.673868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.674303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.674995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:49.675487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:49.675900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:49.747231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:49.755340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-306fd387-65a2-480b-9a61-378984ac4ddc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.093676 Sep 06 11:52:49.756507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 222/413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:49.776628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:49.784450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6254a31-495f-4e75-8231-492bf99de8b2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.159357 Sep 06 11:52:49.785018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 192/414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:49 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:50.128331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:50.128939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:50.130975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:50.137979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.138464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.138901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.139638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.140091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.140765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.430652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:50.438751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-85243ff1-f2d6-4362-870a-daa2f1e563d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.314152 Sep 06 11:52:50.439329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 223/415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:50 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:50.778542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:50.779189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:50.785145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.785622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.786085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.786773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.787730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.788173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.809944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:50.810551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:50.816897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.817382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.817849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.818558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:50.819010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:50.819629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:50.853079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:50.861869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92c233c7-5084-4f8f-93c5-f86d35748809 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.087044 Sep 06 11:52:50.862644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 193/416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:50.969981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:50.978626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e2185547-e77f-474a-a7c6-0d4429148ce6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.172369 Sep 06 11:52:50.979214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 224/417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:50 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:51.464711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:51.465323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:51.474316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:51.474876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:51.475498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:51.476211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:51.476666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:51.477089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:51.546674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:51.555017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3b1e140e-804c-4aae-bb7e-e7aa12e1ef1c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.096521 Sep 06 11:52:51.555588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 194/418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:51 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:51.889985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:51.890774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:51.897537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:51.898038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:51.898467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:51.899143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:51.899590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:51.900005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:51.960800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:51.968379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0104113f-be96-4ec6-b7e2-eb2259e7c624 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.082341 Sep 06 11:52:51.969140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 225/419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:52.000740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:52.001341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:52.007261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.007729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.008150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.008822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.009266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.009703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.360203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:52.367963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c870bc8c-a19a-4ec9-abe3-c1123cf21dfe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.371036 Sep 06 11:52:52.368535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 195/420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:51 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:52.577950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:52.578512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:52.585063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.585238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.585619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.586354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:52.586817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:52.587241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:52.607167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:52.654633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:52.662988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a305e90-fadb-482d-a3ce-97b0be6f50ce tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.088950 Sep 06 11:52:52.663513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 226/421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:52 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:52.997551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:52.998902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:53.007274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.007944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.008182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.009083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.009542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.009998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.075018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:53.082664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-612a16e8-3fee-4b4d-9309-5fbbff491b18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.093034 Sep 06 11:52:53.083235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 196/422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:53.391677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:53.392351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:53.399487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.399978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.400451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.401151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.401609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.402086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.533433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:53.542468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd1f391c-a6f4-409a-a133-4ee88ac270b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.154950 Sep 06 11:52:53.543041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 227/423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:53 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:53.686227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:53.686834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:53.688676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:53.695714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.696199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.696631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.697332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:53.697815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:53.698239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:53.760120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:53.768117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a198295-8a8d-4ddb-a565-e3938a289f7d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.085762 Sep 06 11:52:53.768695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 197/424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:53 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:54.105702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:54.106322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:54.112447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:54.112936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:54.113373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:54.114105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:54.114562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:54.114987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:54.180757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:54.188491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5cc7cf12-5354-4f0c-9d13-a8ba439d1d09 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.086712 Sep 06 11:52:54.189062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 228/425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:54.565830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:54.566447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:54.573121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:54.573604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:54.574076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:54.574767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:54.575220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:54.575640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:54.711486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:54.719204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bdd2891f-515d-4427-b204-f8d2129c006f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.157196 Sep 06 11:52:54.719778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 198/426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:54 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:54.792450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:54.793076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:54.799453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:54.799937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:54.800364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:54.801046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:54.801492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:54.801945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:54.871738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:54.884210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-766737db-6238-4699-b983-635a87e69851 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.095495 Sep 06 11:52:54.885096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 229/427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:54 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:55.212725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:55.213333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:55.219295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:55.219773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:55.220206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:55.220892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:55.221347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:55.221801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:55.284120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:55.292846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f1e94b54-e432-48f7-9d08-f60e10efd688 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.084173 Sep 06 11:52:55.293435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 199/428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:55.742912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:55.743538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:55.749571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:55.750100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:55.750539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:55.751268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:55.751729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:55.752158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:55.905477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:55.911976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:55.913621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:55.914303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9c4b889-d7b0-4e47-acf8-de1e8e679c0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.175901 Sep 06 11:52:55.914905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 230/429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:55 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:55.923765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:55.924615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:55.925347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:55.926564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:55.927377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:55.928715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:55.936483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:56.022842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:56.035125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d61781ee-1f9a-4bb4-bef6-37ba6f4cece0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.129690 Sep 06 11:52:56.036074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 200/430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:55 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:56.317335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:56.317883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:56.324169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:56.324658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:56.325139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:56.325853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:56.326305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:56.326727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:56.394484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:56.404077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c6d3f177-9fc8-438d-a3a8-d21411fa5d17 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.090786 Sep 06 11:52:56.404817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 231/431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:56.938655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:56.939309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:56.945588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:56.946116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:56.946554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:56.947255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:56.947709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:56.948127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:57.059185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:57.059778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:57.066025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:57.066516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:57.067008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:57.067651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:57.068100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:57.068538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:57.098649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:57.107979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0cf8d0da-dc1f-4ac1-9157-84b3911a7ee0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.173580 Sep 06 11:52:57.108466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 201/432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:56 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:57.132252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:57.140752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a7941296-9754-4d8f-8400-8a15bc799f29 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.085313 Sep 06 11:52:57.141329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 232/433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:57 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:57.427423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:57.428059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:57.429915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:57.430600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=10 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:57.436609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:57.437084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:57.437507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:57.438224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:57.438670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:57.439085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:57.500508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:57.509568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52eba09c-a4c1-4528-9094-e18a82649559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.085851 Sep 06 11:52:57.510183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 202/434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:58.132042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:58.132729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:58.134661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:58.141401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:58.141936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:58.142376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:58.143078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:58.143537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:58.143967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:58.165736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:58.166662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:58.172513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:58.173006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:58.173472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:58.174230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:58.174688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:58.175166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:58.242703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:58.252238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-841a5316-1ef7-465e-8c71-670e8896173a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.090918 Sep 06 11:52:58.252783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 203/435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:58 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:58.294056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:58.301723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27294d09-32d6-4410-9a73-10fdc9e65e02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.173625 Sep 06 11:52:58.302310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 233/436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:58 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:58.533469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:58.534112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:58.540847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:58.541309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:58.541769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:58.542455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:58.542908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:58.543327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:58.603808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:58.611356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bb819de5-f3df-43c7-a110-196d515cb78b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.081884 Sep 06 11:52:58.611917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 204/437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:59.276061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:59.276739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:59.283812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:59.284307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:59.284745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:59.285446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:59.285971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:59.286401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:59.327131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:59.327778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:59.334788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:59.335333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:59.335724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:59.336440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:59.336890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:59.337315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:59.351052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:59.359237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6155d1ff-7f91-48be-a6e4-0022c93021fa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.087436 Sep 06 11:52:59.363728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 234/438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:59 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:52:59.477678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:59.485574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-14cc5fad-fe5f-4b3f-8ef3-76b17b0230ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.162435 Sep 06 11:52:59.486194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 205/439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:59 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:52:59.634468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:52:59.634996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:52:59.642070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:59.642567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:59.643004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:59.643715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:52:59.644173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:52:59.644601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:52:59.707974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:52:59.716969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-55660e99-44fb-46f9-9a73-241262d95ea8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.086656 Sep 06 11:52:59.717571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 235/440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:52:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:00.382854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:00.383415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:00.389618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:00.390520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:00.391191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:00.392186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:00.392776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:00.393222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:00.460252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:00.468107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d5c96ae9-ea1c-4eff-bf67-20e213ab509b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.089204 Sep 06 11:53:00.468679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 206/441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:00 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:00.508734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:00.509348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:00.516213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:00.516719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:00.517139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:00.517882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:00.518343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:00.518767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:00.658890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:00.667570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d57fb1ab-2660-442e-99ef-667abb8b89ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.162988 Sep 06 11:53:00.668152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 236/442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:00 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:00.740466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:00.741687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:00.747928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:00.748419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:00.748853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:00.749559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:00.750436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:00.750869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:00.815465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:00.823648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00a8dcae-ed1d-4e8b-b236-67154f6c0cd3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.087188 Sep 06 11:53:00.824233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 207/443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:01.493017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:01.494594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:01.501113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:01.501690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:01.502195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:01.503017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:01.503473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:01.504238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:01.567978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:01.576488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2441d1ed-3474-41dd-b3d0-bd635e963440 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.088077 Sep 06 11:53:01.577048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 237/444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:01 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:01.689757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:01.690365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:01.697132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:01.697606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:01.698057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:01.698770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:01.699213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:01.699627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:01.833675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:01.842035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-56981137-9b59-4b2a-972b-6c07eee66751 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.156119 Sep 06 11:53:01.842608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 208/445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:01 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:01.847517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:01.848137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:01.854597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:01.855083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:01.855521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:01.856250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:01.856710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:01.857133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:01.920598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:01.929393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ddbbf783-5afe-4b03-b8f9-b08989afa4cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.085588 Sep 06 11:53:01.930009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 238/446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:02.599090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:02.600039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:02.605790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:02.606278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:02.606713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:02.607401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:02.607853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:02.608277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:02.671619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:02.679853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc23d760-ba4d-4bf6-8f16-f05ca6bed533 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.084398 Sep 06 11:53:02.680700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 209/447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:02 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:02.866005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:02.866601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:02.873159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:02.873669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:02.874180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:02.874888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:02.875349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:02.875777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:02.952482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:02.953100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:02.959445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:02.960165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:02.960360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:02.961072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:02.961538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:02.961991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:03.012864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:03.020871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-46e4ae7e-2243-4a58-80e7-63c7c8195bea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.158895 Sep 06 11:53:03.021552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 239/448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:02 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:03.026189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:03.033859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2328e49e-8232-4729-8421-203818d1cbb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.085305 Sep 06 11:53:03.034425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 210/449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:03.711898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:03.712507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:03.718609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:03.719093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:03.719522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:03.720215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:03.720668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:03.721091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:03.784519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:03.793180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-65d87a45-c167-4461-8445-54fc312d1a14 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.086090 Sep 06 11:53:03.793778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 240/450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:03 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:04.044143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:04.044798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:04.053250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:04.053780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:04.054224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:04.054949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:04.055380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:04.055825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:04.057581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:04.058243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:04.064716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:04.065213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:04.065707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:04.066455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:04.066919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:04.067369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:04.132144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:04.139816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-888dfafc-1d2b-4188-a131-3f2eff83d382 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.087202 Sep 06 11:53:04.140876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 241/451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:04.196428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:04.204185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7124b78f-5365-4d49-8def-e8390eb99429 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1522 microversion: 2.1 time: 0.163913 Sep 06 11:53:04.204759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 211/452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:04 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:04.816370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:04.816977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:04.824750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:04.825243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:04.825827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:04.826528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:04.826976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:04.827395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:04.891347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:04.900513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d795faaa-634f-4022-9625-e37b2dd55aa8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1217 microversion: 2.1 time: 0.087904 Sep 06 11:53:04.901109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 242/453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:04 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:05.163464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:05.164080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:05.171656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.172361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.172971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.173881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.174542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.175229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.228073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:05.228832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:05.235479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.235908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.236345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.237038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.237494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.237944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.242485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:05.243131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:05.250954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-28446af2-9d47-41a5-adf6-a7dd5b257f78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1262 microversion: 2.1 time: 0.091504 Sep 06 11:53:05.254451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 212/454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:05.374551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:05.383077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-59652306-d9dc-48be-b179-a0f38d8d414e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1502 microversion: 2.1 time: 0.159528 Sep 06 11:53:05.383662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 243/455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:05 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:05.406116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:05.406761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:05.413262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.413793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.414237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.414956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.415439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.415841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.560819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:05.570652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d80c1801-4549-4b11-afca-409c4a4fc601 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1516 microversion: 2.1 time: 0.168351 Sep 06 11:53:05.571788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 213/456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:05 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:05.922976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:05.923597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:05.929939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.930439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.930880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:05.931816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:05.932210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:05.932803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:06.000930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:06.009767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2ac8a20e-b74b-4dff-9276-cc1f11dbfc27 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1265 microversion: 2.1 time: 0.091044 Sep 06 11:53:06.010355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 244/457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:05 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:06.276618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:06.277303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:06.284340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:06.284900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:06.285409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:06.286284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:06.288443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:06.288983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:06.363247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:06.374445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-83fb1a9e-425f-4185-bde8-69912871c3f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1310 microversion: 2.1 time: 0.102990 Sep 06 11:53:06.375154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 214/458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:07.034652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:07.035485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:07.044998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:07.045522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:07.046078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:07.046965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:07.047487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:07.048427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:07.132545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:07.140806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa77d173-0fa5-4871-954a-b5fbab163c3d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1265 microversion: 2.1 time: 0.109685 Sep 06 11:53:07.141384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 245/459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:07 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:07.400765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:07.401704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:07.407958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:07.408526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:07.409059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:07.409870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:07.410384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:07.410869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:07.480336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:07.488112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c013ef79-ea3c-4df4-891a-aeb9aa4f1805 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1328 microversion: 2.1 time: 0.092141 Sep 06 11:53:07.488682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 215/460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:08.065452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:08.067802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:08.082055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.082707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.083161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.083992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.084460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.084916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.114035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'flavor' on Instance uuid 8d49777e-ab48-453f-8bef-9b496e07fb75 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:53:08.167959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:08.168570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:08.179454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.180194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.180797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.181697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.182295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.183158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.215573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-12abe39a-eb06-4785-910e-84297e75d843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/action" status: 200 len: 32 microversion: 2.1 time: 0.153780 Sep 06 11:53:08.216609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 246/461] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:53:08 2022] POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:53:08.227568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:08.228773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:08.235818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.236317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.236759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.237475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.238289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.238724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.261388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:08.265494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:08.270924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ef9817a-9777-47f8-930f-7022aba39cd1 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1283 microversion: 2.1 time: 0.109245 Sep 06 11:53:08.274392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 216/462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:08 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1283 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:08.386770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:08.395435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f230c82f-366f-4f3b-9fdd-dea9e46bac74 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.173326 Sep 06 11:53:08.396022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 247/463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:08 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:08.512326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:08.513035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:08.519346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.519857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.520297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.521471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:08.521983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:08.522519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:08.657085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:08.665521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1576cf51-8283-4276-94ef-6b4b0106d774 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.157327 Sep 06 11:53:08.666099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 217/464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:09.297976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:09.298594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:09.305612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:09.306130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:09.306569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:09.307306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:09.307765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:09.308194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:09.374104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:09.381895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f5982ef6-05a5-4929-9ac2-8e6bd773e749 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1283 microversion: 2.1 time: 0.087781 Sep 06 11:53:09.382466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 248/465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:09 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:09.418811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:09.419428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:09.425732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:09.426254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:09.426686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:09.427992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:09.429157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:09.429634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:09.566294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:09.574059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-89ab3796-ff32-487e-8a97-4842027bd9e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.159003 Sep 06 11:53:09.574633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 218/466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:09 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:09.688515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:09.689131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:09.701432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:09.701724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:09.702012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:09.702719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:09.703175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:09.703599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:09.836871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:09.844691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4c93cbbc-b6fe-4d7f-ac54-83cde253ee37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.160155 Sep 06 11:53:09.845271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 249/467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:10.405890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:10.406506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:10.413109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:10.413584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:10.414036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:10.414737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:10.415189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:10.415607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:10.482695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:10.490491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c444d8c-a75c-4c92-84a4-9c28fc02ca2c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1283 microversion: 2.1 time: 0.089544 Sep 06 11:53:10.490918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 219/468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:10 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1283 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:10.597610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:10.598194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:10.605503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:10.606026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:10.606458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:10.607159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:10.607615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:10.608036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:10.744104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:10.751920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71d7d4c2-6a65-4bf7-8234-73b573133bc3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.158230 Sep 06 11:53:10.752846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 250/469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:10 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:10.870150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:10.870716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:10.877144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:10.877638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:10.878235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:10.879010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:10.879472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:10.879891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:11.015902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:11.024473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-edb9270d-1b3f-4843-8cb5-baa8db9609e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.159266 Sep 06 11:53:11.025057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 220/470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:11.515974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:11.516816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:11.525974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:11.539791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:11.540493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:11.543921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:11.543921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:11.544165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:11.647265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:11.657556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc8149dd-4a07-4bee-8fca-d5ab6a931cbf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1271 microversion: 2.1 time: 0.147705 Sep 06 11:53:11.672419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 251/471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:11 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:11.776392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:11.777015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:11.796342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:11.796342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:11.796342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:11.797718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:11.798241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:11.798681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:12.049790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:12.050618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:12.060168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:12.060978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:12.061818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:12.062780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:12.063563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:12.064894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:12.087415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:12.108397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c9d10668-4b73-4aef-b7f9-a59537d92310 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.337337 Sep 06 11:53:12.108996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 221/472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:11 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:12.263144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:12.274976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a1ca8a6-076e-4cd5-8724-5f9c29298570 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.229900 Sep 06 11:53:12.276525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 252/473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:12.345723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-732680ad-5b2d-43d5-b656-ac9bd5b33ea7 req-88d7b261-9b94-4302-9b70-a49382832f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:12.359692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-732680ad-5b2d-43d5-b656-ac9bd5b33ea7 req-88d7b261-9b94-4302-9b70-a49382832f77 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:12.360575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-732680ad-5b2d-43d5-b656-ac9bd5b33ea7 req-88d7b261-9b94-4302-9b70-a49382832f77 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:12.361347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-732680ad-5b2d-43d5-b656-ac9bd5b33ea7 req-88d7b261-9b94-4302-9b70-a49382832f77 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:12.381228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-732680ad-5b2d-43d5-b656-ac9bd5b33ea7 req-88d7b261-9b94-4302-9b70-a49382832f77 service nova] Creating event network-changed:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 11:53:12.386425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-732680ad-5b2d-43d5-b656-ac9bd5b33ea7 req-88d7b261-9b94-4302-9b70-a49382832f77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044496 Sep 06 11:53:12.387341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 222/474] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:53:12.689661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:12.690861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:12.703064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:12.703981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:12.704764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:12.706103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:12.706952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:12.707746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:12.873455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:12.882662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-838c71b5-4737-4c5b-945f-28f3920c8c34 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.200475 Sep 06 11:53:12.887433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 253/475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:12 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:13.132238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:13.133035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:13.140125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:13.141166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:13.141998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:13.142904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:13.143558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:13.144175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:13.287589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:13.296557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9ed5cdec-6a5a-4663-9730-4895aaa66796 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.169256 Sep 06 11:53:13.297103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 223/476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:13 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:13.303214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:13.304221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:13.310699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:13.311546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:13.312358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:13.313384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:13.327473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:13.327926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:13.466762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:13.475440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee968bd8-93e4-43b6-a401-0d9443d6d7ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.176610 Sep 06 11:53:13.476030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 254/477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:13.910433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:13.911057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:13.917893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:13.918376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:13.918815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:13.919499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:13.919950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:13.920369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:14.067345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:14.076144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e4dfe4d-c7ae-454a-b15f-2d08caf5edf8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.169603 Sep 06 11:53:14.076714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 224/478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:13 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:14.321508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:14.322568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:14.328497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:14.328978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:14.329415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:14.330146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:14.330950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:14.333475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:14.487345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:14.495910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6e283ffd-219c-4874-b6db-8b2411bd75e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.179472 Sep 06 11:53:14.496685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 255/479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:14 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:14.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:14.501091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:14.508926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:14.509408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:14.509864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:14.510557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:14.511001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:14.511415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:14.654614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:14.663556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-48d7c8e2-42cb-4b6c-8df3-2db6c3d2dc2a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.168379 Sep 06 11:53:14.664241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 225/480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:15.105112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:15.105878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:15.112956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:15.113447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:15.113918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:15.115235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:15.115962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:15.116433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:15.276858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:15.287559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e1a33cf-f04c-4acf-a3b1-52cd4a90be1d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.185629 Sep 06 11:53:15.288774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 256/481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:15 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:15.523110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:15.525728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:15.534636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:15.535259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:15.535696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:15.536977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:15.537396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:15.537841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:15.686880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:15.687517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:15.695555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:15.696043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:15.696470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:15.697175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:15.697636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:15.698268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:15.708180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:15.720617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12ecef08-b40b-4865-bd8d-4b8b0843b003 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.203008 Sep 06 11:53:15.721784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 226/482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:15 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:15.847945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:15.857840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:15.867910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f65fc33-73cc-4eb4-abde-b448af1492fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.184788 Sep 06 11:53:15.868898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 257/483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:16.313349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:16.313985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:16.320286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:16.320697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:16.321134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:16.321870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:16.322329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:16.322750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:16.460826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:16.468323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9d87e8f5-b37f-439d-ab16-86e9680f47bc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.158849 Sep 06 11:53:16.468882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 227/484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:16 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:16.745761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:16.746464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:16.753467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:16.753983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:16.754425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:16.755152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:16.755646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:16.756126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:16.892555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:16.893432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:16.894243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:16.900904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:16.901385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:16.901852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:16.901976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b76236ae-8386-4187-abe9-0913edec4fab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.160839 Sep 06 11:53:16.902560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 258/485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:16 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:16.902710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:16.903184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:16.903607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:17.030853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:17.039215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc02eb6f-6755-4e8b-916e-fbaa9d7260c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.150130 Sep 06 11:53:17.039786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 228/486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:17.492428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:17.493328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:17.500331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:17.501272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:17.501906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:17.502808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:17.503429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:17.504010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:17.653410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:17.661202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6652153f-bbf7-4ee9-beb9-b085bbdffdb6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.173312 Sep 06 11:53:17.662237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 259/487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:17 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:17.924331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:17.924951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:17.931860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:17.932346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:17.932784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:17.933493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:17.933976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:17.934637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:18.063789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:18.065462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:18.079974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:18.086961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:18.087747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:18.088377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:18.089171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:18.089278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-46ba66d7-abec-4396-81d5-b95151f2f7d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.168716 Sep 06 11:53:18.089688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:18.090122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:18.090242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 229/488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:17 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:18.243138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:18.251521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-43c23da9-7e2b-431e-933a-74a283ce0c44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.191999 Sep 06 11:53:18.264671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 260/489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:18.685784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:18.686388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:18.692352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:18.692817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:18.693244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:18.693956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:18.694398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:18.694810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:18.835094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:18.843399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b91625dc-95b5-4aa9-a9f9-b5df065c39ec tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.161367 Sep 06 11:53:18.844319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 230/490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:18 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:19.115343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:19.116598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:19.125137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:19.126243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:19.126766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:19.127837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:19.128601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:19.129501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:19.275057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:19.276700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:19.278237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:19.283804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2d980455-9797-4016-8dd2-baa1bbbb74f4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.173915 Sep 06 11:53:19.284401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 261/491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:19 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:19.287232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:19.288120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:19.288829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:19.289539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:19.290015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:19.290431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:19.566997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:19.583343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-01142378-e21d-4f7d-a1e7-eb4371c9babd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.307765 Sep 06 11:53:19.584988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 231/492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:19.867496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:19.868020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:19.874075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:19.874558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:19.874993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:19.875686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:19.876149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:19.876577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:20.017804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:20.026153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-20fcd041-efda-4665-9552-00580de418de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.163235 Sep 06 11:53:20.026935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 262/493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:19 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:20.307331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:20.308048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:20.314013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:20.314504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:20.314941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:20.315626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:20.316204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:20.316628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:20.452734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:20.461575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4287adda-4f0c-4cbe-989f-d5f4639ed474 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.158092 Sep 06 11:53:20.462490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 232/494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:20 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:20.606789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:20.608387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:20.612299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=80 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:20.616888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:20.617389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:20.618175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:20.619060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:20.619525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:20.619951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:20.766376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:20.775654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-967175fe-90b7-4b19-bebc-c6e571ae2795 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.172596 Sep 06 11:53:20.776465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 263/495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:21.048572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:21.049100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:21.056060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:21.056547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:21.056977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:21.057696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:21.058158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:21.058574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:21.195819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:21.203423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cb17642e-ed0c-4b6b-b178-4f914863aa88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.158784 Sep 06 11:53:21.204002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 233/496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:21 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:21.485149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:21.485833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:21.493033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:21.493524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:21.493994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:21.494699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:21.495148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:21.495572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:21.628529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:21.636510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-96afb3f7-4412-4376-bbe6-fbf0fe9eb1ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.155215 Sep 06 11:53:21.637092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 264/497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:21 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:21.800883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:21.801539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:21.807637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:21.808114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:21.808539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:21.809217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:21.809691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:21.810108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:21.814119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:21.946338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:21.953921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-649d03ad-25f8-4ebd-b1be-476d99864a16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.157407 Sep 06 11:53:21.954491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 234/498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:22.226429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:22.227042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:22.232928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:22.233398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:22.233863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:22.234538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:22.234985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:22.235402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:22.371976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:22.379631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-98a2e389-b305-4d19-ab88-ff4335494d33 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.157749 Sep 06 11:53:22.380638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 265/499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:22 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:22.660622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:22.662612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:22.669468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:22.669985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:22.670428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:22.671116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:22.671568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:22.671988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:22.805686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:22.813481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f651728-39c1-465f-adae-1992d0ccc925 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.156732 Sep 06 11:53:22.814003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 235/500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:22 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:22.977971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:22.978592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:22.984982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:22.985464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:22.985934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:22.986653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:22.987108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:22.987539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:23.125560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:23.134001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc65503e-20c9-4563-90f7-e322f0ca7b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.160237 Sep 06 11:53:23.134662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 266/501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:23.402915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:23.403469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:23.409391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:23.409917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:23.410357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:23.411041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:23.411559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:23.411979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:23.542537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:23.550180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e4825fa-dde7-4f60-aa9f-d12b159c9d07 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.151165 Sep 06 11:53:23.550746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 236/502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:23 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:23.839833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:23.840590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:23.848366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:23.849552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:23.850313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:23.851253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:23.852039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:23.852661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:24.019564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:24.030859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89dcaed8-e302-445f-8c12-5d5bb48c4b67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.195810 Sep 06 11:53:24.032682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 267/503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:23 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:24.158737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:24.159549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:24.165839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=80 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:24.168290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:24.168985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:24.169484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:24.170226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:24.170675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:24.171125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:24.320274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:24.328597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1af4857-939b-4512-b000-f156c379dc6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.174017 Sep 06 11:53:24.329177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 237/504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:24.574872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:24.575403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:24.581425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:24.581939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:24.582382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:24.583662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:24.584132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:24.584565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:24.719834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:24.727355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab8712f7-982f-4b90-9ac4-4c38106e32fc tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.156822 Sep 06 11:53:24.727987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 268/505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:24 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:25.055864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:25.056508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:25.062859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:25.063346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:25.063785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:25.064480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:25.064938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:25.065361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:25.210675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:25.218517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4540e139-3a1e-44ae-90d3-9351695d9fa4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.167119 Sep 06 11:53:25.224169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 238/506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:25 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:25.352122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:25.352740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:25.369504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:25.370101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:25.370539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:25.371253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:25.371713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:25.372142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:25.504962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:25.512600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c973df81-7637-40e9-ab02-7ef454620da7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.165304 Sep 06 11:53:25.513167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 269/507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:25.750398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:25.750925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:25.757598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:25.758114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:25.760540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:25.760540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:25.760540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:25.760540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:25.906840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:25.914503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e75e6e94-0a99-4459-a9c0-5ba1f7025ddf tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.167980 Sep 06 11:53:25.915063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 239/508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:25 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:26.244781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:26.245385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:26.251445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:26.251931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:26.252847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:26.253039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:26.253491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:26.253960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:26.389889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:26.398147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90c0503d-889d-4b58-be77-6d90f8eb2aa8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.157897 Sep 06 11:53:26.398726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 270/509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:26 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:26.538866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:26.539955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:26.548447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:26.548996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:26.549483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:26.550214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:26.550669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:26.551092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:26.707749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:26.716407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-01f9e5c9-70a1-4042-bc4a-2947dfdb75cb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.183760 Sep 06 11:53:26.716979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 240/510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:26.942596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:26.944636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:26.954006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:26.954521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:26.955003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:26.956254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:26.956722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:26.957537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:27.115411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:27.123650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1267f9cb-4afb-4d9e-a430-3744e8ed72a0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.185588 Sep 06 11:53:27.124291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 271/511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:26 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:27.421489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:27.422147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:27.428753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:27.429237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:27.429700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:27.430401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:27.430858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:27.431285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:27.566202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:27.574677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1edf82d0-5132-4831-8b53-6371a836c8b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.157068 Sep 06 11:53:27.575247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 241/512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:27 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:27.741089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:27.741743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:27.747715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:27.748196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:27.748630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:27.749321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:27.749800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:27.750251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:27.891923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:27.906208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1fae198a-1e64-42b1-8746-9bcf8fbfc7ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.170143 Sep 06 11:53:27.906801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 272/513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:28.147001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:28.147808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:28.154209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.154694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.155179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:28.155877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.156337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.156758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:28.287455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:28.295243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9f1071b2-472e-46a7-87ad-9f2d49fdc672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.152856 Sep 06 11:53:28.295740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 242/514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:28 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:28.597797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:28.598334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:28.605382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.605907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.606347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:28.607042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.607498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.607929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:28.746343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:28.754048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ba41edbf-2f30-45c0-9271-6e088d210930 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.160377 Sep 06 11:53:28.754613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 273/515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:28 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:28.929437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:28.930053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:28.936045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.936527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.936962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:28.937668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:28.938133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:28.938560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.075479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:29.085050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d0b4a75a-1b15-4e8c-8a80-8aff2eb491cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.159276 Sep 06 11:53:29.085636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 243/516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:29.320072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:29.320687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:29.326739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:29.327336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:29.327824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.328558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:29.329056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:29.329486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.350975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:29.570309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:29.585535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c4f573b-cf30-4ee7-a214-60dbdfd5260b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.270421 Sep 06 11:53:29.587573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 274/517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:29 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:29.777878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:29.778584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:29.784735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:29.785316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:29.785867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.786635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:29.787660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:29.788090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:29.926177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:29.935406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b6f55de6-beec-4673-a12a-d6a9d8610c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.161050 Sep 06 11:53:29.945842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 244/518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:29 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:30.107527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:30.108136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:30.114497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.114980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.115404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.116219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.116528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.116942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.146117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-eb563e1e-6a2d-4de3-bbb8-d6c83f2bc169 req-16950e47-6206-4d7e-b1d6-3a9d309cef0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b1fce5-45d3-4c1d-b55a-302d6148d629", "tag": "2b182c90-3baf-4a40-bdd7-32ec072351ee"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:30.158747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-eb563e1e-6a2d-4de3-bbb8-d6c83f2bc169 req-16950e47-6206-4d7e-b1d6-3a9d309cef0b service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.159345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-eb563e1e-6a2d-4de3-bbb8-d6c83f2bc169 req-16950e47-6206-4d7e-b1d6-3a9d309cef0b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.159870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-eb563e1e-6a2d-4de3-bbb8-d6c83f2bc169 req-16950e47-6206-4d7e-b1d6-3a9d309cef0b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.173611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-eb563e1e-6a2d-4de3-bbb8-d6c83f2bc169 req-16950e47-6206-4d7e-b1d6-3a9d309cef0b service nova] Creating event network-changed:2b182c90-3baf-4a40-bdd7-32ec072351ee for instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 on hv-cinder-85604 Sep 06 11:53:30.180172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-eb563e1e-6a2d-4de3-bbb8-d6c83f2bc169 req-16950e47-6206-4d7e-b1d6-3a9d309cef0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038237 Sep 06 11:53:30.180869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 245/519] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:53:30.291460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:30.299243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a6d3e07b-16ab-47bf-9cf3-35d8efa1dbdd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.195552 Sep 06 11:53:30.299812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 275/520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:30.610589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:30.611238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:30.618214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.618706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.619150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.619832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.620290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.620714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.753892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:30.761658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f13e926a-7a8e-46f3-aca9-e5528a5cdf70 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.155332 Sep 06 11:53:30.762219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 246/521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:30 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:30.958114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:30.959242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:30.965463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.965978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.966417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:30.967093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:30.967541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:30.967958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.097682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:31.105728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0c8d98bd-4491-40ea-be2d-a247de7738c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.151319 Sep 06 11:53:31.106225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 276/522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:30 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:31.323811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:31.324456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:31.330861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:31.331349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:31.331782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.332471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:31.332928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:31.333353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.462544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:31.470117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-65940665-9779-4ecb-855b-4d3890468d52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.150214 Sep 06 11:53:31.470674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 247/523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:31.785095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:31.785695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:31.792735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:31.793216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:31.793667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.794369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:31.794827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:31.795253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:31.928732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:31.936324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-19b1978f-29a9-41ee-866c-bb5ac405b701 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.155254 Sep 06 11:53:31.936892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 277/524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:31 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:32.128504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:32.129629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:32.137620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.138237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.138674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.139376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.139830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.140579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.271811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:32.279894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c90c1f7d-8ab2-4547-8b4e-958fa67c5df1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.155397 Sep 06 11:53:32.280510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 248/525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:32 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:32.493268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:32.493898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:32.499800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.500310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.501003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.501390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.501863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.502281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.635896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:32.643935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f46ec2b2-d4a9-4e97-b7a0-d7cc258d56e7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.155328 Sep 06 11:53:32.644497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 278/526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:32.960328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:32.960936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:32.966947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.967423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.967853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:32.968536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:32.968995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:32.969415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:33.100859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:33.109692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a27d099c-87ca-48e8-9e9f-edb82c23bc7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.153869 Sep 06 11:53:33.110272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 249/527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:32 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:33.303418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:33.305408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:33.312027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:33.312515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:33.312948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:33.313733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:33.314123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:33.314547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:33.463862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:33.471908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fecf459b-2eba-4465-9e20-82f2dc70214f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.172383 Sep 06 11:53:33.472300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 279/528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:33 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:33.667897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:33.668565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:33.674784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:33.675258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:33.675682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:33.676360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:33.676806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:33.677218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:34.015422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:34.023705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c56feca-b694-4fa1-92b7-dadc90ea79c1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.360714 Sep 06 11:53:34.024279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 250/529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:34.132957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:34.133609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:34.139588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:34.140070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:34.140753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:34.141440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:34.141930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:34.142359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:34.276508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:34.284132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d488dbf5-c21a-4dea-b819-2fad1cf816c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.155662 Sep 06 11:53:34.284697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 280/530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:34 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:34.496542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:34.497067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:34.503491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:34.504022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:34.504563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:34.505304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:34.505790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:34.506749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:34.526515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:34.638707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:34.647546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b4cd36c4-8a20-4c6e-b705-c6374448d9e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.154246 Sep 06 11:53:34.648123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 251/531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:34 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:35.047234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:35.047917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:35.056448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.056938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.057380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.058113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.058570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.058993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.221372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:35.230972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8c847d42-565b-4772-8454-45431fcea506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.187315 Sep 06 11:53:35.237895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 281/532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:35.307352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:35.308008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:35.314144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.314629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.315095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.315794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.316247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.316671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.511105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:35.519072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63cc826b-38a5-41c9-8947-147542c26df3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.215645 Sep 06 11:53:35.519636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 252/533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:35 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:35.671677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:35.672289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:35.679030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.679649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.680099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.680808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:35.681275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:35.681735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:35.816787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:35.825508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4be349f8-a1df-4967-9914-2417b8bfce2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.157452 Sep 06 11:53:35.826353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 282/534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:35 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:36.253437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:36.254080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:36.260970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.261460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.261937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.262646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.263098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.263519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.396233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:36.404590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04b659cd-5255-473f-89a0-8e11caf065c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.155242 Sep 06 11:53:36.405174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 253/535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:36.550879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:36.551574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:36.570405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.570953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.571465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.572277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.572801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.573290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.722203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:36.730721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5df3650d-eb02-47d7-8b67-7b1e1047b20a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.191957 Sep 06 11:53:36.731315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 283/536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:36 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:36.850210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:36.851111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:36.857851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.858379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.858880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.859583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:36.860038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:36.860460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:36.995973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:37.003653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4d7a1283-fefa-407d-b97f-e670d657bdbc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.157969 Sep 06 11:53:37.004225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 254/537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:36 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:37.429663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:37.430292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:37.436255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:37.436744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:37.437178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:37.437894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:37.438350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:37.438779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:37.567056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:37.574913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2f5b5846-135e-420e-ab9b-6853ecc838e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.149276 Sep 06 11:53:37.575505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 284/538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:37.754149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:37.754758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:37.761133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:37.761606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:37.762064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:37.762746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:37.763187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:37.763600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:37.902566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:37.913054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cd9f01fb-a152-47b2-bf9e-e4fae8bf6ba9 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.162816 Sep 06 11:53:37.914022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 255/539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:37 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:38.028487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:38.029013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:38.035149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.035659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.036062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.036745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.037246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.037685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.168812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:38.176532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-81bf3581-edd1-4004-a7d1-140b567fc5eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.152049 Sep 06 11:53:38.177141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 285/540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:38 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:38.598483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:38.599093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:38.606077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.606591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.607058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.607745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.608195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.608648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.743197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:38.750721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a77721b-f3c6-4ba8-a854-54c3db990dbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.156122 Sep 06 11:53:38.751303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 256/541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:38.936931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:38.937569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:38.944180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.944661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.945090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:38.945928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:38.946661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:38.946746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:39.080256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:39.088540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-682fb22b-9e58-4016-97e5-b9c848a625aa tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.155370 Sep 06 11:53:39.089115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 286/542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:38 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:39.211329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:39.211884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:39.217894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:39.218376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:39.218808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:39.219493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:39.219941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:39.220363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:39.353343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:39.361000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04248f95-d300-4523-9a5a-a232cd4fd668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.154585 Sep 06 11:53:39.361564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 257/543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:39 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:39.775207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:39.775773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:39.781831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:39.782318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:39.782757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:39.783449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:39.783907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:39.784333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:39.915211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:39.922887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e93002ad-6860-46ad-8710-d8d112e09dc4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.151759 Sep 06 11:53:39.923450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 287/544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:40.111538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:40.112018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:40.118540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:40.119013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:40.119437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:40.120126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:40.120548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:40.120966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:40.253127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:40.260834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-49d00c71-9848-4543-b59a-042918ba9de8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.153187 Sep 06 11:53:40.261426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 258/545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:40 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:40.384403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:40.384946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:40.391648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:40.392142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:40.392612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:40.393278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:40.393773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:40.394314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:40.525979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:40.533579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef35ed64-476c-48dd-a6a3-27fc115d059d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.153187 Sep 06 11:53:40.534173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 288/546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:40 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:40.946797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:40.947417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:40.953585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:40.954097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:40.954535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:40.955232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:40.955689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:40.956117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.088743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:41.096335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20e4caff-aa95-49ab-9db7-b78082004ed4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.153785 Sep 06 11:53:41.096897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 259/547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:41.284254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:41.284999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:41.288103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:53:41.288253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 11:53:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 (ip 10.222.0.18) !!! Sep 06 11:53:41.296251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:41.296728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:41.297169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.297906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:41.298368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:41.298798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.428679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:41.436461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f304b3c6-1863-4347-87d0-825a5608044d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.156011 Sep 06 11:53:41.437029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 289/548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:41 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:41.556777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:41.557329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:41.563299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:41.563780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:41.564245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.564930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:41.565386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:41.565849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:41.701284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:41.709616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aefd8933-8408-4e67-bc33-eaaf01a0ec15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.156143 Sep 06 11:53:41.710341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 260/549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:41 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:42.120196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:42.120718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:42.126720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.127210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.127649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.128341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.128800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.129225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.263586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:42.271552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2cb88917-0e3b-4b87-b3c6-211a0490c1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.155410 Sep 06 11:53:42.272164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 290/550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:42.459704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:42.460311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:42.466244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.466720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.467149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.467832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.468284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.468707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.598449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:42.606548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f4e48e9-3897-49db-952c-fa35cf18a1b8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.150845 Sep 06 11:53:42.607117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 261/551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:42 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:42.732520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:42.733064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:42.739483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.740001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.741051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.741780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:42.742239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:42.742665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:42.746587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:42.873282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:42.881985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bd44d30b-b555-4afa-9c89-01188f321f06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.153182 Sep 06 11:53:42.882572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 291/552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:42 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:43.294005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:43.294639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:43.300676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.301158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.301591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.302305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.303711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.303944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.434617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:43.442280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b8691b0f-af5c-4837-ae3e-ddf620fc5dcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.152097 Sep 06 11:53:43.443057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 262/553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:43.629280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:43.629979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:43.636558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.637050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.637485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.638224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.638687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.639114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.770088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:43.778374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3dcd094e-7b6b-4fbf-b3d6-e0c9153307d5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.152980 Sep 06 11:53:43.778944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 292/554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:43 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:43.904657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:43.905206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:43.911286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.911833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.912265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:43.912979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:43.913453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:43.913997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.043518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:44.051647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c33434b-8b6d-430d-9712-a0017107e4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.150925 Sep 06 11:53:44.052320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 263/555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:43 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:44.466012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:44.466725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:44.472772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:44.473252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:44.473705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.474891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:44.475343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:44.475759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.614263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:44.622797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2895c0a2-99f8-44eb-93f0-e2064ed3d78a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.161271 Sep 06 11:53:44.623375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 293/556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:44.801330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:44.801975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:44.808524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:44.809007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:44.809440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.810156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:44.810612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:44.811089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:44.942529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:44.951079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f24b3f2-ce89-4842-8159-bb61bd0b9711 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.154053 Sep 06 11:53:44.951664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 264/557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:44 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:45.075310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:45.075978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:45.082907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.083270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.084133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.084836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.085289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.085813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.230357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:45.241792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2deaaea9-c268-40b5-8182-1ec3e80f8a4c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.168770 Sep 06 11:53:45.242810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 294/558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:45 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:45.646199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:45.646736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:45.652651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.653122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.653548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.654245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.654690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.655109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.783511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:45.791929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5aac4bb0-429d-4b69-8882-0a30558c6eff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.149651 Sep 06 11:53:45.792502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 265/559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:45.973956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:45.975091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:45.981120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.981635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.982096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:45.982782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:45.983239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:45.983663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.126655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:46.134670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ee8e616-1707-45f8-a270-a0d95e070dee tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.164611 Sep 06 11:53:46.135241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 295/560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:45 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:46.264245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:46.264853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:46.271090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.271886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.272322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.273017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.273471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.273933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.422120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:46.431365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04a3bd95-a886-4d6d-9b65-2207cc2a0a52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.170875 Sep 06 11:53:46.454046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 266/561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:46 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:46.816278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:46.816886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:46.823120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.823538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.824009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.824775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:46.825261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:46.825961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:46.955746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:46.964147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a374f1f0-81ef-4c18-ace6-b0c71283a3c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.151602 Sep 06 11:53:46.964681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 296/562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:47.156971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:47.157494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:47.164324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.164807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.165246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.165974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.166428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.166852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.302219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:47.310457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-213885a3-38cc-4ab6-8290-c4da07cb8b66 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.157481 Sep 06 11:53:47.311037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 267/563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:47 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:47.458360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:47.459380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:47.466011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.466501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.466944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.467644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.468105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.468534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.597025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:47.605224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3685c4d4-f06d-439d-bd1d-f41a4895ca75 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.150947 Sep 06 11:53:47.605857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 297/564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:47 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:47.987548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:47.988149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:47.995071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.995548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.995981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:47.996660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:47.997104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:47.997519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.001530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:48.127721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:48.136515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-225c060c-7747-4404-a2d2-9c97568d06ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.152788 Sep 06 11:53:48.137077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 268/565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:48.333148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:48.333813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:48.339793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:48.340275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:48.340703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.341378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:48.341885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:48.342303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.473136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:48.481117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8a2055dd-0d10-4982-b59f-848e0a3d3ccb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.151781 Sep 06 11:53:48.481730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 298/566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:48 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:48.628221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:48.628826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:48.642289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:48.642784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:48.643305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.644151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:48.644715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:48.645241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:48.787953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:48.795661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3add23d5-8570-48a6-9f18-a8196a284a6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.171300 Sep 06 11:53:48.796232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 269/567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:48 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:49.160282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:49.160900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:49.167568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.168047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.168477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.169156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.169613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.170060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.300508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:49.309905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c27fe4f0-0e41-4ea4-bb7c-3e1b10a2568e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.153389 Sep 06 11:53:49.310479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 299/568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:49.504297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:49.504913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:49.511317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.511701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.512233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.512814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.513218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.513632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.648281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:49.655962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae5a38d1-5fba-408d-a4ab-4fe00a7110ba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.155548 Sep 06 11:53:49.656535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 270/569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:49 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:49.818945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:49.819495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:49.826018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.826572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.827013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.827710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:49.828170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:49.828596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:49.961179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:49.968729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-31981815-af26-422f-86c7-32162f710ba5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.153744 Sep 06 11:53:49.969291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 300/570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:49 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:50.333043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:50.334568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:50.340154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:50.340637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:50.341071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:50.341796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:50.342255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:50.342676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:50.473860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:50.481917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1e4e7a27-1440-4951-ad36-c2f8d7704804 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.152755 Sep 06 11:53:50.482486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 271/571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:50.680065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:50.680728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:50.682746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=76 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:50.688463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:50.688951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:50.689388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:50.690109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:50.690566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:50.690991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:50.820808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:50.829183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e4a814c5-c2a0-4d05-87cc-3766135a3e43 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.153519 Sep 06 11:53:50.829776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 301/572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:50 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:50.991681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:50.992318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:50.998234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:50.998708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:50.999131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:50.999804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.000247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.000662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.128576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:51.137278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9242be6c-0a58-4bb7-8d6d-192ffa43cd16 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.149385 Sep 06 11:53:51.137869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 272/573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:50 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:51.505702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:51.506229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:51.512159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.512632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.513061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.513769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.514218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.514635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.653371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:51.661214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aec88c08-5de5-4c71-acbe-c9c1d76a9324 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.159402 Sep 06 11:53:51.662459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 302/574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:51.852666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:51.853184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:51.859065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.859545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.859965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.860640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:51.861083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:51.861494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:51.995083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:52.002627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a0463271-bac2-408d-ae1d-c04c7a125df8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.153947 Sep 06 11:53:52.003260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 273/575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:51 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:52.160288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:52.160903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:52.167853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.168351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.168795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.169481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.169971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.170396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.298459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:52.306786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b3e121ae-ac29-400d-a66d-ccd92fe74c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.150372 Sep 06 11:53:52.307348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 303/576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:52 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:52.685938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:52.686605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:52.692557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.693577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.694048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.694910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:52.695532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:52.696084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:52.829149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:52.837427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b47ea867-c5ec-4efe-8e79-0faf4b7db6ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.155731 Sep 06 11:53:52.838037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 274/577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:53.027248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:53.027896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:53.034313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.034742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.035175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.035865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.036319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.038133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.173597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:53.182237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8d7aec03-c286-44e2-b6ea-9f12a8106477 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.158789 Sep 06 11:53:53.182812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 304/578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:53 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:53.330981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:53.331590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:53.338898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.339394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.339829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.340524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.340976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.341397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.469362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:53.477165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eebc81de-1331-4742-b579-464eb7c79d90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.150168 Sep 06 11:53:53.477759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 275/579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:53 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:53.861065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:53.861739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:53.868307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.868795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.869231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:53.869991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:53.870450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:53.870876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.004444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:54.012205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-32bd5e83-df43-4843-bf51-02d805a737d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.155027 Sep 06 11:53:54.012778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 305/580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:54.205160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:54.205814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:54.207703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=78 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:54.214163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.214643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.215068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.215747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.216227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.216638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.348309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:54.356560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bfdaa136-f375-4fa1-8763-73d5c47d1d22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.155195 Sep 06 11:53:54.357136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 276/581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:54 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:54.499868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:54.500481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:54.507631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.508116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.508550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.509257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.509738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.510165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.602497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-6ee84ca9-531d-4b67-a08c-19a2ae0bc0c6 req-4778b070-8a63-4758-abd7-cd6f3270c9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "name": "network-vif-plugged", "status": "completed", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:54.612742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6ee84ca9-531d-4b67-a08c-19a2ae0bc0c6 req-4778b070-8a63-4758-abd7-cd6f3270c9e4 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:54.613222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6ee84ca9-531d-4b67-a08c-19a2ae0bc0c6 req-4778b070-8a63-4758-abd7-cd6f3270c9e4 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:54.613892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6ee84ca9-531d-4b67-a08c-19a2ae0bc0c6 req-4778b070-8a63-4758-abd7-cd6f3270c9e4 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:54.627122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-6ee84ca9-531d-4b67-a08c-19a2ae0bc0c6 req-4778b070-8a63-4758-abd7-cd6f3270c9e4 service nova] Creating event network-vif-plugged:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 11:53:54.634898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-6ee84ca9-531d-4b67-a08c-19a2ae0bc0c6 req-4778b070-8a63-4758-abd7-cd6f3270c9e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036076 Sep 06 11:53:54.635895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 277/582] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:53:54.653407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:54.661205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4c5c4b38-bcd6-4b0e-ae3a-d0a68c2bf1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.165482 Sep 06 11:53:54.661789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 306/583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:54 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:55.036620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:55.037567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:55.043912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:55.044394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:55.044828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.045519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:55.046000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:55.046432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.176518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:55.184974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c045a29-ebc0-4637-bbae-c134305b88d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.152907 Sep 06 11:53:55.185537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 278/584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:55.380101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:55.380607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:55.387819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:55.388302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:55.388733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.389421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:55.389899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:55.390567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.528243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:55.531685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:55.536592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e529116f-4878-4b3c-9152-6c43f50150f4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.160484 Sep 06 11:53:55.537691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 307/585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:55 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:55.686480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:55.687086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:55.692925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:55.693407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:55.693866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.694541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:55.694993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:55.695441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:55.827270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:55.836061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-791088d9-b4a1-4b82-b027-b2bc338e4061 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.153277 Sep 06 11:53:55.836646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 279/586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:55 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:56.211484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:56.212007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:56.218142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.218623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.219058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.219745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.220208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.220632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.369762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:56.377957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5716a5c5-65dc-4290-90e5-cb5d58bde9b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.171956 Sep 06 11:53:56.378553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 308/587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:56.561252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:56.562029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:56.581466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.582070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.582578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.583419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.584036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.584538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.753738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:56.762240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4784c6c4-5f0e-4684-85f4-014e724b0b5f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.205500 Sep 06 11:53:56.762825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 280/588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:56 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:53:56.860896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:56.861519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:56.868281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.868779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.869220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:56.870109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:56.871069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:56.871069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:57.061246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:57.070448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-98855429-638a-4add-a498-bc8ac1821def tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.213705 Sep 06 11:53:57.071268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 309/589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:56 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:57.402286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:57.402892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:57.409154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:57.409704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:57.410148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:57.410881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:57.411338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:57.411764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:57.549243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:57.558959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12aac61e-2103-4694-89da-68d049a82290 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.160236 Sep 06 11:53:57.573682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 281/590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:57.787877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:57.788991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:57.795759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:57.796250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:57.796805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:57.797364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:57.798053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:57.798766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:57.996689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:58.006230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a055f545-bd9e-456f-a90f-0ce244b5f6d2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.222965 Sep 06 11:53:58.008133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 310/591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:57 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:58.094317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:58.095846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:58.103069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:58.103836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:58.104446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:58.105154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:58.105607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:58.106060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:58.289038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:58.299233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71257194-9067-44b2-8bae-9dbfd3fbb1df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.209302 Sep 06 11:53:58.299989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 282/592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:58 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:58.588653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:58.589210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:58.595378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:58.595862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:58.596308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:58.597006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:58.597458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:58.597919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:58.734127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:58.743876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-87c3dba4-5c3f-4bca-a0be-116fbd06b0d0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.159050 Sep 06 11:53:58.745068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 311/593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:59.033508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:59.034141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:59.041104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.041583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.042171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.042860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.043336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.043749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.182146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:59.190723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91e64a02-6b87-44ef-827a-51d755c19ea4 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.160999 Sep 06 11:53:59.191473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 283/594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:59 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:59.322935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:59.323552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:59.330479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.330973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.331415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.332117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.332574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.333002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.485045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:59.494765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fdc15261-baf0-4e2c-abb7-c5b729f1dc91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.176244 Sep 06 11:53:59.496091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 312/595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:59 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:53:59.581182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-71dffc50-4bc6-4303-934f-0ef88db61e89 req-2ceebf07-a0ed-4efe-aabd-e8d33eb7ddd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1fce5-45d3-4c1d-b55a-302d6148d629", "name": "network-vif-plugged", "status": "completed", "tag": "2b182c90-3baf-4a40-bdd7-32ec072351ee"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:53:59.595418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-71dffc50-4bc6-4303-934f-0ef88db61e89 req-2ceebf07-a0ed-4efe-aabd-e8d33eb7ddd4 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.597033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-71dffc50-4bc6-4303-934f-0ef88db61e89 req-2ceebf07-a0ed-4efe-aabd-e8d33eb7ddd4 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.597773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-71dffc50-4bc6-4303-934f-0ef88db61e89 req-2ceebf07-a0ed-4efe-aabd-e8d33eb7ddd4 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.615729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-71dffc50-4bc6-4303-934f-0ef88db61e89 req-2ceebf07-a0ed-4efe-aabd-e8d33eb7ddd4 service nova] Creating event network-vif-plugged:2b182c90-3baf-4a40-bdd7-32ec072351ee for instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 on hv-cinder-85604 Sep 06 11:53:59.622867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-71dffc50-4bc6-4303-934f-0ef88db61e89 req-2ceebf07-a0ed-4efe-aabd-e8d33eb7ddd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045831 Sep 06 11:53:59.623182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 284/596] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:53:59.767839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:53:59.768527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:53:59.774715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.775198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.775627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.776321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:53:59.776775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:53:59.777218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:53:59.915744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:53:59.923404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-070d0fd3-d91a-406f-b155-311b8366f57c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.159840 Sep 06 11:53:59.923984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 313/597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:53:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:00.216982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:00.217935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:00.224218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.225078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.225580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.226299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.226762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.227219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.361976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:00.373419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-053b9ec0-8a70-4388-be6d-65df0b76a614 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.160537 Sep 06 11:54:00.374138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 285/598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:00 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:00.522414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:00.523029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:00.530054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.530878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.531320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.532025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.532482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.532904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.668689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:00.677324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc162d9c-5160-41ab-ab5e-edffc777d519 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.159492 Sep 06 11:54:00.678025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 314/599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:00 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:00.946705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:00.947472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:00.962000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.963200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.963699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.964352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:00.964813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:00.965258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:00.982658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:01.160041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:01.168474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f5ebb36d-01ac-49c8-81ed-9b15d55e51cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1358 microversion: 2.1 time: 0.226155 Sep 06 11:54:01.169136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 286/600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:01.397147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:01.397842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:01.403827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:01.404320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:01.404756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:01.405449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:01.405935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:01.406368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:01.541957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:01.551649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9294715e-d9f9-463e-82b6-72c5aed85f88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.158806 Sep 06 11:54:01.552593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 315/601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:01 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:01.701470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:01.702264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:01.708905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:01.709894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:01.710458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:01.711173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:01.711814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:01.712245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:01.880293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:01.887963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-44f9f198-d068-493b-aa57-1649f96c5090 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.190593 Sep 06 11:54:01.888534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 287/602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:01 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:02.192333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.193623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:02.199789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.200273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.200710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.201401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.201896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.202359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.333325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:02.341714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-397f987c-a31f-4584-a7c8-ead884a4c630 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1548 microversion: 2.1 time: 0.153211 Sep 06 11:54:02.342282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 316/603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:02.364842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.365456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:02.371522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.372007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.372439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.373126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.373582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.374058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.500043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:02.508853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b0974799-8286-4c3e-ab71-73d45dba51d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1548 microversion: 2.1 time: 0.147959 Sep 06 11:54:02.509422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 288/604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:02.531041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.535876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:02.536634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Searching by: {'deleted': False, 'project_id': '474249b02d3140b6bae6ec312cdd142f'} {{(pid=127122) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 11:54:02.543720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.544352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.544611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.545489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.545971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.546391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.575648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.576477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:02.582635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.583687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.584228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.585027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.585583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.586120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.641621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.multi_cell_list [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127122) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 11:54:02.733630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:02.743141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a02a545-81b8-45c4-8a6d-c9558ce76497 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.171306 Sep 06 11:54:02.743927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 289/605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:02.755378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-42e18de6-d582-46ba-a419-0121f48c8d6e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.220024 Sep 06 11:54:02.755378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 317/606] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers => generated 342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:02.766311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.766847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:02.773111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.773596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.774071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.774763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.775218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.775640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.911639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:02.913073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:02.919446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.919931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.920360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.921049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:02.921498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:02.921940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:02.923135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:02.934897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dde86af9-b23c-41a7-8518-23941771f9e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1548 microversion: 2.1 time: 0.172618 Sep 06 11:54:02.935580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 290/607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:03.069580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:03.079686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c7092ce9-997b-49d6-a106-b7c51073f53e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.171890 Sep 06 11:54:03.080497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 318/608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:02 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:03.769868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:03.770480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:03.777193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:03.777788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:03.778231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.778930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:03.779384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:03.779807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:03.906788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:03.914551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5d473d78-ba42-4afa-8500-f4e2748bc80a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.148664 Sep 06 11:54:03.915128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 291/609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:03 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:04.104086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:04.104633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:04.111060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:04.111851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:04.111957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:04.112644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:04.113096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:04.113523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:04.251764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:04.260139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-589a2af4-b8f0-48fa-b834-4d34d9f4c078 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.160535 Sep 06 11:54:04.260908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 319/610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:04 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:04.937359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:04.938005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:04.944289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:04.944768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:04.945735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:04.945921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:04.946380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:04.946799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:05.083247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:05.092342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1bcb47f8-8aba-4559-8b5f-a61ba1933468 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.158831 Sep 06 11:54:05.092917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 292/611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:04 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:05.287446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:05.288606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:05.296511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:05.297093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:05.297541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:05.298269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:05.298731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:05.299160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:05.435564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:05.444216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-19348910-bdf8-4738-97b3-c83a9b9ecf8d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.164428 Sep 06 11:54:05.445034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 320/612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:05 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:06.116738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:06.117503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:06.124353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:06.124843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:06.125277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:06.126003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:06.126458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:06.126907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:06.259933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:06.274773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c29edaa9-6232-41b6-8d6f-97acc16b6564 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.162412 Sep 06 11:54:06.275814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 293/613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:06 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:06.467684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:06.468297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:06.475314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:06.475828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:06.476268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:06.476953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:06.477408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:06.477863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:06.609600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:06.618608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21874904-45f0-4f24-bafd-c6fdbd29fabc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.154763 Sep 06 11:54:06.619285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 321/614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:06 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:07.302150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:07.303271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.310839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.311326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.311756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.312461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.312912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.313333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.460905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:07.468914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c9c4a90-11f3-46f0-a7b0-cc67d6a14bfb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.174003 Sep 06 11:54:07.469638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 294/615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:07 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:07.643030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:07.643614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.650857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.651340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.651776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.652464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.652920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.653351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.785467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:07.793131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-509189f0-46c6-4b39-8d7b-75fb2e0c29a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1502 microversion: 2.1 time: 0.154335 Sep 06 11:54:07.793713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 322/616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:07 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:07.816120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc9a4f26-093b-4dbf-ab3a-d996ebe580e2"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:07.819314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.825472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.825988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.826415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.827144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.827598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.828023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.853780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] HTTP exception thrown: Cannot 'attach_volume' instance 8d49777e-ab48-453f-8bef-9b496e07fb75 while it is in vm_state rescued Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Request method failure captured: Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/os-volume_attachments HTTP/1.1 Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 74 Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP8WhChmO0e747b94LLsv4KV_p1rCUXE932zqUOAR-UE2UtrNZCN0tbUBjL-WFeDraD4XTNQjdd93nctg0ubt0PCEJlAskaXtNvL_FtcYEd3DWYFBXAnyeG32oQm549hSGwUJJjmoxkUxn8TyQxBjR7moTn5NqLQ26v7kR2Gh3P1mU Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 11:54:07.855509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ef6b481491244111a479eb91e3594ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}] Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 41bc35497fe94ababe0c824a429168d3 Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {"volumeAttachment": {"volumeId": "bc9a4f26-093b-4dbf-ab3a-d996ebe580e2"}} Sep 06 11:54:07.857373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Cannot 'attach_volume' instance 8d49777e-ab48-453f-8bef-9b496e07fb75 while it is in vm_state rescued Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'server_id': '8d49777e-ab48-453f-8bef-9b496e07fb75', 'body': {'volumeAttachment': {'volumeId': 'bc9a4f26-093b-4dbf-ab3a-d996ebe580e2'}}} Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:54:07.858208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8d49777e-ab48-453f-8bef-9b496e07fb75 while it is in vm_state rescued Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:07.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8d49777e-ab48-453f-8bef-9b496e07fb75 while it is in vm_state rescued Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Returning 409 to user: Cannot 'attach_volume' instance 8d49777e-ab48-453f-8bef-9b496e07fb75 while it is in vm_state rescued {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e002335-7307-437b-a297-d0b29d4ff33b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044854 Sep 06 11:54:07.860999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 295/617] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:54:07 2022] POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:54:07.867773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:07.868297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.874614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.875092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.875523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.876207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.876656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.877185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.917291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:07.942498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-39b85313-7311-41d2-a99a-a76eba8e321d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/action" status: 202 len: 0 microversion: 2.1 time: 0.078875 Sep 06 11:54:07.943807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 323/618] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:54:07 2022] POST /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:54:07.952034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:07.952644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:07.958746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.959218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.959656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:07.960344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:07.960800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:07.961223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:08.092248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:08.100009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4668e597-4272-48f3-a2ce-292420e06ee5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.151795 Sep 06 11:54:08.100757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 296/619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:07 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:08.496349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:08.497171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:08.503682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:08.504199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:08.504776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:08.506231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:08.506716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:08.507388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:08.683338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:08.695983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-22691297-7e95-4a65-b1ab-4844f5a46233 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.204540 Sep 06 11:54:08.697186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 324/620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:08 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:08.763050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a53333-4387-4373-b5a6-ea18b241b05f"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:08.765670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:08.771828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:08.772343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:08.772836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:08.773736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:08.774186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:08.774606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:09.123486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:09.124132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:09.130727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:09.131320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:09.131817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:09.132519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:09.132978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:09.133407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:09.330335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:09.339560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71cb1679-e1b5-4277-b4b9-23a5ed43cb55 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.219853 Sep 06 11:54:09.340204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 325/621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:09 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:09.719624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:09.720255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:09.728321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:09.728828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:09.729270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:09.730011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:09.730472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:09.730906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:09.898942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:09.920015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a6669da-271a-4e1c-a120-9a6ce5a2db47 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1313 microversion: 2.1 time: 0.204178 Sep 06 11:54:09.934759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 326/622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:09 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:10.365215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:10.366321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:10.373156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:10.373691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:10.374126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:10.374838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:10.375291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:10.375715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:10.581200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:10.589089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b5347dcd-c9fd-4999-a369-1b979ed60705 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.228435 Sep 06 11:54:10.589738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 327/623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:10 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:10.773814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cffb1376-32ef-4077-bd7c-08609bcc2fb6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.014715 Sep 06 11:54:10.775024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 297/624] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:54:08 2022] POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 194 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:54:10.944087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:10.945687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:10.953631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:10.954535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:10.955492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:10.956445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:10.957133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:10.957887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:11.129743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:11.140354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ebadbccd-acba-43e9-bf5a-cb39f5ac40d8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1498 microversion: 2.1 time: 0.199983 Sep 06 11:54:11.141150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 328/625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:10 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1498 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:11.614171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:11.615439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:11.621742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:11.622230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:11.622701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:11.623402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:11.623860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:11.624283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:11.763087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:11.771625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-921d24b3-fcc3-4b33-a4c8-7d0b0f068599 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.162201 Sep 06 11:54:11.772516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 298/626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:11 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:12.794328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:12.794975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:12.797443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:12.802977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:12.803406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:12.803851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:12.804542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:12.805002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:12.805432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:12.940634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:12.949022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-abc4ca3c-a806-4d44-be96-7eff2d89eb3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.158481 Sep 06 11:54:12.949533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 329/627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:12 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:13.524814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:13.525323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:13.531851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.532331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.532763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.533456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.533928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.534347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.563308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:54:13.652010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-88871e67-1acc-4c5f-b9bf-b5d3ca09f03c tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "DELETE /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 204 len: 0 microversion: 2.1 time: 0.131287 Sep 06 11:54:13.652594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 299/628] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 11:54:13 2022] DELETE /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:54:13.661069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:13.661743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:13.668600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.669131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.669749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.670436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.670885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.671306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.804055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:13.811695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7dae8be1-1659-441e-b058-ff1109c20675 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.154531 Sep 06 11:54:13.812261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 330/629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:13 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:13.972904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:13.973605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:13.980371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.980877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.981329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.982044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:13.982499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:13.982932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:13.987473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:14.121154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:14.128805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69ca20fc-bad8-4cd0-8070-22e19dd7c33f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.160163 Sep 06 11:54:14.129362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 300/630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:13 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:14.834952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:14.835602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:14.842036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:14.842535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:14.842974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:14.843671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:14.844127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:14.844556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:15.025927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:15.034217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c12415c-5233-4768-839c-731bc7a7a2c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.203353 Sep 06 11:54:15.034907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 331/631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:14 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:15.153588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:15.154331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:15.161769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:15.162853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:15.163298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:15.164000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:15.164456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:15.164880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:15.321132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:15.330828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f00a8b95-5699-49b4-9c65-9fe338cc8d03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.181075 Sep 06 11:54:15.331513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 301/632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:15 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:16.058900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:16.059518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:16.066129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:16.066624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:16.067064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:16.067787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:16.068817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:16.069204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:16.222095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:16.245472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0c25576c-ba72-40c9-b9d7-fdebcb5677cb tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.176146 Sep 06 11:54:16.245472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 332/633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:16 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:16.355695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:16.356575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:16.362921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:16.367068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:16.367068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:16.367068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:16.367068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:16.367397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:16.537511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:16.546548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9d7d68df-d928-4d2d-a93f-d0e162bc6768 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.194475 Sep 06 11:54:16.547119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 302/634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:16 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:17.260921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:17.261612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:17.270310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:17.270860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:17.271946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:17.272662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:17.273145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:17.273578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:17.464491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:17.473114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-07ffaef1-5d16-48fa-bf4c-ff708ffe7235 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.216075 Sep 06 11:54:17.489586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 333/635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:17 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:17.572131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:17.572673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:17.579687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:17.580172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:17.580701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:17.581556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:17.582152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:17.582582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:17.728852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:17.737108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8884c9b3-0d36-4016-a24e-29c923b47d8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.169324 Sep 06 11:54:17.737780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 303/636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:17 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:18.498537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:18.499142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:18.506605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.507237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.507686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.508411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.508874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.509305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.648975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:18.657024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6cfa9fcc-4436-43a5-81ac-f0aa5e6827c2 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.162388 Sep 06 11:54:18.657589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 334/637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:18 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:18.761494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:18.762071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:18.769283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.769797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.770235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.770930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:18.771566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:18.772524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:18.927080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:18.935810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e71e215-c16b-4110-9496-b944d9d4acd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.178287 Sep 06 11:54:18.936389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 304/638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:18 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:19.680796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:19.681410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:19.687990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:19.688477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:19.688914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:19.689609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:19.690105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:19.690533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:19.829873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:19.838523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3fdd06b3-f266-4f41-990b-c89b5d1f1f22 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.161535 Sep 06 11:54:19.839119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 335/639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:19 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:19.959057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:19.959689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:19.966159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:19.966637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:19.967072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:19.967765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:19.968219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:19.968645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:20.099859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:20.107283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12bb7047-9116-4932-82d7-403cd303148c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.152144 Sep 06 11:54:20.107845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 305/640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:19 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:20.861277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:20.862116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:20.864736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=70 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:20.872040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:20.872542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:20.872981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:20.873714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:20.874182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:20.875036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.010242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:21.018299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d39694b7-4070-4fb0-b7cd-5255d78b3474 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.160850 Sep 06 11:54:21.018882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 336/641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:20 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:21.130065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:21.131232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:21.137753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:21.138305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:21.138675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.139403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:21.139852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:21.140528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:21.275155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:21.282792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-75c921d1-451e-4246-bc4a-91fbcce889bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.156651 Sep 06 11:54:21.283361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 306/642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:21 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:22.041700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:22.042273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:22.048915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:22.049402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:22.049877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:22.050578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:22.051031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:22.051453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:22.198046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:22.206067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c721a777-a4db-4b7f-90db-c26fcaf24d90 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.168246 Sep 06 11:54:22.206649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 337/643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:22 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:22.311747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:22.312816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:22.325333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:22.326250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:22.327094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:22.328350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:22.329201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:22.330059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:22.477226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:22.485186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0243ecb7-9081-439c-b332-9499f6507c88 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1510 microversion: 2.1 time: 0.180744 Sep 06 11:54:22.485781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 307/644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:22 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:23.228738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:23.229278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:23.235771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:23.236254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:23.236687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:23.237369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:23.237858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:23.238280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:23.370694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:23.378394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-77c975bb-6ba3-412c-a073-0d124e105873 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.153817 Sep 06 11:54:23.378966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 338/645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:23 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:23.508553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:23.509121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:23.515958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:23.516447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:23.516888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:23.517635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:23.518194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:23.518683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:23.651237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:23.658837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b040dbf-8421-4dac-900a-615573887a8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1516 microversion: 2.1 time: 0.154326 Sep 06 11:54:23.659405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 308/646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:23 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:24.402357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:24.402978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:24.409286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:24.409799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:24.410227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:24.410908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:24.411357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:24.412425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:24.551173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:24.554652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:24.559571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-384105bf-19a2-4ddd-8a64-5352320b6ab7 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.161261 Sep 06 11:54:24.560138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 339/647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:24 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:25.582138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:25.582748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:25.585118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:25.590649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:25.591134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:25.591579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:25.592279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:25.592738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:25.593171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:25.749075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:25.757364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f2f78d91-c0dd-4b7e-b663-1a25413e5115 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.179112 Sep 06 11:54:25.758258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 309/648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:25 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:26.784926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:26.785538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:26.793578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:26.794092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:26.794532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:26.795225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:26.795683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:26.796108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:26.937323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:26.945898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-abeb998f-4398-4e47-a154-0e4c55fe4053 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.166322 Sep 06 11:54:26.946483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 340/649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:26 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:27.976226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:27.976880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:27.983658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:27.984144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:27.984581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:27.985288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:27.985789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:27.986215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:28.131869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:28.143879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d89f316-13f2-45a1-a047-b88d94c40bba tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.171601 Sep 06 11:54:28.157790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 310/650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:27 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:29.168887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:29.169508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:29.175774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:29.176263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:29.176702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:29.177401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:29.177940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:29.178599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:29.311101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:29.319506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8291481f-7ab5-4706-8d91-f54f8896db1a tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.153853 Sep 06 11:54:29.320199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 341/651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:29 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:30.343296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:30.343936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:30.351474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:30.351974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:30.352417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:30.353127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:30.353584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:30.354041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:30.520594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:30.529370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-299b5399-049e-43c8-8fab-27fe27e2fbe0 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1504 microversion: 2.1 time: 0.189930 Sep 06 11:54:30.529999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 311/652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:30 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:31.028467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-90c76cd3-50ef-48f1-ae66-1e713561759c req-bb6f345c-1fe1-4641-a967-f55cfaa0a0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1fce5-45d3-4c1d-b55a-302d6148d629", "name": "network-vif-deleted", "tag": "2b182c90-3baf-4a40-bdd7-32ec072351ee"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:31.039715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-90c76cd3-50ef-48f1-ae66-1e713561759c req-bb6f345c-1fe1-4641-a967-f55cfaa0a0a8 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:31.040202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-90c76cd3-50ef-48f1-ae66-1e713561759c req-bb6f345c-1fe1-4641-a967-f55cfaa0a0a8 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:31.040636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-90c76cd3-50ef-48f1-ae66-1e713561759c req-bb6f345c-1fe1-4641-a967-f55cfaa0a0a8 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:31.055524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-90c76cd3-50ef-48f1-ae66-1e713561759c req-bb6f345c-1fe1-4641-a967-f55cfaa0a0a8 service nova] Creating event network-vif-deleted:2b182c90-3baf-4a40-bdd7-32ec072351ee for instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 on hv-cinder-85604 Sep 06 11:54:31.060830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-90c76cd3-50ef-48f1-ae66-1e713561759c req-bb6f345c-1fe1-4641-a967-f55cfaa0a0a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036115 Sep 06 11:54:31.061447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 342/653] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:31.420807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-97ba9d4e-01ba-4ab5-9adb-114a339afe41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'create', calling method: .version_select at 0x7f97f503f820>, body: {"keypair": {"name": "tempest-keypair-446791067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaozpLyEn+ow8859fLWra29qZ0bbRNr0+Px1mOOqb18VqbSWuA/ogFK+oWG4qTisjCHNRZU+ZTmPxPNkihFxn0mI2roXYH+cBv1caYYig2HVT2YNuyYbFqsVfiPjaMpqw=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:31.439097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-97ba9d4e-01ba-4ab5-9adb-114a339afe41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for project ef6b481491244111a479eb91e3594ae4. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:54:31.443511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-97ba9d4e-01ba-4ab5-9adb-114a339afe41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for user 41bc35497fe94ababe0c824a429168d3 and project ef6b481491244111a479eb91e3594ae4. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:54:31.473802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-97ba9d4e-01ba-4ab5-9adb-114a339afe41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057505 Sep 06 11:54:31.476191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 312/654] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 11:54:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:31.533323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:31.534326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:31.545914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:31.546676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:31.547294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:31.548169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:31.549091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:31.549918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:31.555706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:31.556489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:31.562979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:31.563543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:31.564046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:31.564821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:31.565342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:31.565884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:31.610788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:31.611474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:31.612061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:31.618429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lazy-loading 'fault' on Instance uuid 42b1fce5-45d3-4c1d-b55a-302d6148d629 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:54:31.669202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:31.678453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb1e2d5e-abf4-4d00-a7fb-144e6191afef tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 200 len: 1303 microversion: 2.1 time: 0.127937 Sep 06 11:54:31.679051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 313/655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:31 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:31.785129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:31.796697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-572f9091-3226-4046-bbb1-5a347aa66e97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1594 microversion: 2.1 time: 0.269397 Sep 06 11:54:31.797799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 343/656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1594 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:32.702512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:32.703805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 42b1fce5-45d3-4c1d-b55a-302d6148d629] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:32.711057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:32.712014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:32.712623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:32.713513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:32.714143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:32.715072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:32.733063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] HTTP exception thrown: Instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 could not be found. Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Request method failure captured: Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 HTTP/1.1 Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzR9V0R0DSCJqXLX2bwOX3C57a5CALnuU0uRn6hVFCJA2DHsWPmBKmzmxM6qSW5zRJ2V7sxhh_jDasSOQ_iaTtb6a6xAqe9qPyAGeDkk37xg7czvHip3loyUN9Iu3ClH7DE0ghWOfxNjGHQ4FUndA6IgXOiRhavWA6k2UkqsUQnifPI Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 474d58de54cb4c44ab3885e9a2943a0c Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesActionsTest-750696358 Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 11:54:32.735641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/474d58de54cb4c44ab3885e9a2943a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/474d58de54cb4c44ab3885e9a2943a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_474d58de54cb4c44ab3885e9a2943a0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/474d58de54cb4c44ab3885e9a2943a0c"}]}] Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesActionsTest-750696358 Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 474d58de54cb4c44ab3885e9a2943a0c Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesActionsTest-750696358 Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesActionsTest-750696358-project Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: a597decac02943339b9909d41020d8c7 Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesActionsTest-750696358-project Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 could not be found. Sep 06 11:54:32.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '42b1fce5-45d3-4c1d-b55a-302d6148d629'} Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 could not be found. Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:54:32.738475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 could not be found. Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 could not be found. Sep 06 11:54:32.739980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 11:54:32.743573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Returning 404 to user: Instance 42b1fce5-45d3-4c1d-b55a-302d6148d629 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:54:32.744853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2a14cafe-7f78-49a5-bf1d-ffb2b0501ee3 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629" status: 404 len: 111 microversion: 2.1 time: 0.046035 Sep 06 11:54:32.745574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 314/657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:32 2022] GET /compute/v2.1/servers/42b1fce5-45d3-4c1d-b55a-302d6148d629 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:54:32.952934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1940460677", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "networks": [{"uuid": "cd8b7a53-a53d-4aec-8785-942e20afceca"}]}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:33.055880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] validate_networks() for [('cd8b7a53-a53d-4aec-8785-942e20afceca', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:54:33.438215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1905825865", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "494bff09-0910-4e09-b2f9-dce2571e584d"}], "security_groups": [{"name": "tempest-securitygroup--83384579"}], "key_name": "tempest-keypair-446791067", "user_data": "}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:33.598738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] validate_networks() for [('494bff09-0910-4e09-b2f9-dce2571e584d', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:54:33.671661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:54:33.672095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:54:33.672873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:54:33.673553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:54:33.674272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:54:33.684021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:33.684496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:33.685102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:33.685853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:33.686298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:33.686716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:33.710278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Getting quotas for project 474d58de54cb4c44ab3885e9a2943a0c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:54:33.714734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Getting quotas for user a597decac02943339b9909d41020d8c7 and project 474d58de54cb4c44ab3885e9a2943a0c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:54:33.727304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:54:33.729789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:54:33.782743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e61c47e5-38e9-4522-b80c-0df8942a6976 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835891 Sep 06 11:54:33.783884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 344/658] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:54:33.798138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed93614d-2b96-46cb-8db5-3d49a05a3c88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:33.799028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed93614d-2b96-46cb-8db5-3d49a05a3c88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:33.883851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ed93614d-2b96-46cb-8db5-3d49a05a3c88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:33.904455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed93614d-2b96-46cb-8db5-3d49a05a3c88 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1214 microversion: 2.1 time: 0.111756 Sep 06 11:54:33.905973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 345/659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:33 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:34.730893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:54:34.731449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:54:34.731931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:54:34.732344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:54:34.732790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:54:34.743818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:34.744430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:34.744938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:34.745799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:34.746327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:34.746827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:34.767897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for project ef6b481491244111a479eb91e3594ae4. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:54:34.773200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Getting quotas for user 41bc35497fe94ababe0c824a429168d3 and project ef6b481491244111a479eb91e3594ae4. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:54:34.787000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:54:34.790878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:54:34.845868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9398753d-9ca0-4cf3-a886-a8a913fba4df tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.414802 Sep 06 11:54:34.853719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 315/660] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:54:33 2022] POST /compute/v2.1/servers => generated 407 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:54:34.858918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a01beab4-ee74-4360-a1c8-66bb21d23775 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:34.860496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a01beab4-ee74-4360-a1c8-66bb21d23775 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:34.936601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:34.937920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:34.949376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a01beab4-ee74-4360-a1c8-66bb21d23775 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:34.951550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:34.952462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:34.953314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:34.954729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:34.956718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:34.957818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:34.968336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a01beab4-ee74-4360-a1c8-66bb21d23775 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1245 microversion: 2.1 time: 0.112943 Sep 06 11:54:34.969421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 346/661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:35.063479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:35.080749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5600fd6f-2338-485e-8365-9a707d5180a6 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1266 microversion: 2.1 time: 0.154942 Sep 06 11:54:35.081702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 316/662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:34 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:35.126374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-51d10084-0d5c-49ea-bec0-64b078445847 req-411f7a55-d0db-4690-9e92-fa86b7bd2466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:35.140387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-51d10084-0d5c-49ea-bec0-64b078445847 req-411f7a55-d0db-4690-9e92-fa86b7bd2466 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:35.140944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-51d10084-0d5c-49ea-bec0-64b078445847 req-411f7a55-d0db-4690-9e92-fa86b7bd2466 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:35.141440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-51d10084-0d5c-49ea-bec0-64b078445847 req-411f7a55-d0db-4690-9e92-fa86b7bd2466 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:35.155568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-51d10084-0d5c-49ea-bec0-64b078445847 req-411f7a55-d0db-4690-9e92-fa86b7bd2466 service nova] Creating event network-changed:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 11:54:35.162835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-51d10084-0d5c-49ea-bec0-64b078445847 req-411f7a55-d0db-4690-9e92-fa86b7bd2466 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040484 Sep 06 11:54:35.163839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 347/663] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:36.000236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:36.000835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:36.008385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.008866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.009321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.010062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.010731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.011324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.090881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:36.100673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b46f604c-0854-4541-8118-ffc0e91b13cc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1249 microversion: 2.1 time: 0.104957 Sep 06 11:54:36.102198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 317/664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:36.121411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:36.123007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:36.130387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.132531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.133309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.134268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.134938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.135571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.230332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:36.246841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-749ac120-3334-4bf6-92dc-84e53c4217c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1266 microversion: 2.1 time: 0.129209 Sep 06 11:54:36.247927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 348/665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:36 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:36.312003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-151237612"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:36.312914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:36.319966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.320459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.320899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.321610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.322102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.322555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.483956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.network.security_group_api [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Adding security group 02d7ac28-9827-47fe-b1f1-59166501d4f0 to port fef9b85e-f761-4bd9-b17c-5448646f031d Sep 06 11:54:36.894961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4e2e3f4-fac0-47b6-a901-f77c216d1443 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.587225 Sep 06 11:54:36.895745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 318/666] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:54:36 2022] POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:54:36.906082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:36.906995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:36.914829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.915391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.915874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:36.916699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:36.917351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:36.918004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:37.082085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:37.094689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66562298-a655-416c-9017-7e6840d2d01d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1640 microversion: 2.1 time: 0.193029 Sep 06 11:54:37.095426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 349/667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1640 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:37.125868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:37.126417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:37.134845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:37.134845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:37.135365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:37.136159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:37.136461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:37.136890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:37.141815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:37.178395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-92affd48-a0f0-4004-924d-9057b1830bd3 req-8af7a609-ab7c-4cfb-b043-e7dcc494dc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:37.190479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-92affd48-a0f0-4004-924d-9057b1830bd3 req-8af7a609-ab7c-4cfb-b043-e7dcc494dc7d service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:37.191525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-92affd48-a0f0-4004-924d-9057b1830bd3 req-8af7a609-ab7c-4cfb-b043-e7dcc494dc7d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:37.191525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-92affd48-a0f0-4004-924d-9057b1830bd3 req-8af7a609-ab7c-4cfb-b043-e7dcc494dc7d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:37.204501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-92affd48-a0f0-4004-924d-9057b1830bd3 req-8af7a609-ab7c-4cfb-b043-e7dcc494dc7d service nova] Creating event network-changed:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 11:54:37.210824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-92affd48-a0f0-4004-924d-9057b1830bd3 req-8af7a609-ab7c-4cfb-b043-e7dcc494dc7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036085 Sep 06 11:54:37.211753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 350/668] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:37.214680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:37.222802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1eed0f8f-ca5e-4607-a0aa-0be83e70e240 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1249 microversion: 2.1 time: 0.101384 Sep 06 11:54:37.223387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 319/669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:37.270710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:37.272118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:37.279191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:37.279690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:37.280133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:37.280860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:37.281323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:37.281793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:37.350992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:37.362441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-240a79fe-6f05-42f7-b834-665a5c16564e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1266 microversion: 2.1 time: 0.095536 Sep 06 11:54:37.363496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 351/670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:37 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:38.248035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:38.248734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:38.255351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:38.255939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:38.256478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:38.257858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:38.258228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:38.258658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:38.323461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:38.331672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b02c28f-96b2-4ccf-a4a3-3b0cb554f204 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1249 microversion: 2.1 time: 0.087455 Sep 06 11:54:38.332262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 320/671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:38.397080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:38.397874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:38.409606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:38.410978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:38.411465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:38.412347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:38.413517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:38.414146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:38.498298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:38.505979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8beb37aa-37e6-4a96-b785-192ecad82287 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1266 microversion: 2.1 time: 0.112792 Sep 06 11:54:38.506545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 352/672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:38 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:39.368734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:39.369532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:39.378031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:39.378623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:39.379143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:39.379934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:39.380520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:39.381019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:39.466294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:39.476771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d00fdcee-264c-4ef2-9e05-7193012ddfb8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1297 microversion: 2.1 time: 0.116956 Sep 06 11:54:39.485000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 321/673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:39.529904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:39.531677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:39.545064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:39.546247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:39.547135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:39.548280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:39.548970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:39.549878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:39.901903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:39.913592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-251b74bd-6b64-48e6-8e96-22e157862db8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1272 microversion: 2.1 time: 0.387717 Sep 06 11:54:39.931453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 353/674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:39 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1272 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:40.501996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:40.502824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:40.509387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:40.509911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:40.510386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:40.511096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:40.511556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:40.511988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:40.676250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:40.704873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-782a4148-0dfe-4905-a7d4-f5f2b610f173 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1297 microversion: 2.1 time: 0.206387 Sep 06 11:54:40.708185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 322/675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1297 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:40.941764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:40.941764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:40.948939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:40.949418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:40.949895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:40.950616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:40.951087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:40.951515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:41.198156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:41.215209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89ef53e9-50ed-41dd-8a34-e5879362b04d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.278437 Sep 06 11:54:41.216333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 354/676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:40 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:41.734833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:41.735973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:41.746937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:41.747700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:41.748349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:41.750379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:41.751243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:41.752109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:41.825893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-2e1ebc5b-32a6-4077-bdb2-9c077be2a117 req-01975581-870e-4b10-b0c9-047db558104b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cfa4ce-bcd4-42e4-aee4-8af09c9d5487", "tag": "0090bdb2-14f0-4900-8ee6-8b7edfe7acea"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:41.856860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2e1ebc5b-32a6-4077-bdb2-9c077be2a117 req-01975581-870e-4b10-b0c9-047db558104b service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:41.858215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2e1ebc5b-32a6-4077-bdb2-9c077be2a117 req-01975581-870e-4b10-b0c9-047db558104b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:41.859239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2e1ebc5b-32a6-4077-bdb2-9c077be2a117 req-01975581-870e-4b10-b0c9-047db558104b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:41.877268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:41.888903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fe2d77f6-6c2f-4802-8f25-4a1709dcba83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1303 microversion: 2.1 time: 0.159672 Sep 06 11:54:41.891307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 323/677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:41.905005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-2e1ebc5b-32a6-4077-bdb2-9c077be2a117 req-01975581-870e-4b10-b0c9-047db558104b service nova] Creating event network-changed:0090bdb2-14f0-4900-8ee6-8b7edfe7acea for instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 on hv-cinder-85604 Sep 06 11:54:41.918275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-2e1ebc5b-32a6-4077-bdb2-9c077be2a117 req-01975581-870e-4b10-b0c9-047db558104b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101422 Sep 06 11:54:41.920691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 355/678] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:42.252346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:42.253487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:42.265765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:42.266269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:42.274032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:42.275065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:42.275749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:42.276358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:42.641664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:42.652894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a9eb677b-59cf-43a0-a79a-0484e0989761 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.404746 Sep 06 11:54:42.653499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 324/679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:42 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:42.934039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:42.934757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:42.943147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:42.943642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:42.945067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:42.945837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:42.946173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:42.946782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:43.301413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:43.314782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ad6cb727-d945-4dbb-8b71-f0fdfea7efb2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.385488 Sep 06 11:54:43.316122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 356/680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:43.680169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:43.681009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:43.688265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:43.688757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:43.689196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:43.689943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:43.690389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:43.690838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:43.929874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:43.948051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e79af22-953b-4762-9373-0c67d555b640 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.274736 Sep 06 11:54:43.960346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 325/681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:43 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:43.966210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:43.970359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-38d3b08c-c1a0-47ab-af6a-37407fc04115 req-5b2e4ac5-da07-461a-a67c-ac4e972217aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:43.981942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-38d3b08c-c1a0-47ab-af6a-37407fc04115 req-5b2e4ac5-da07-461a-a67c-ac4e972217aa service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:43.982509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-38d3b08c-c1a0-47ab-af6a-37407fc04115 req-5b2e4ac5-da07-461a-a67c-ac4e972217aa service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:43.983017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-38d3b08c-c1a0-47ab-af6a-37407fc04115 req-5b2e4ac5-da07-461a-a67c-ac4e972217aa service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:43.996231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-38d3b08c-c1a0-47ab-af6a-37407fc04115 req-5b2e4ac5-da07-461a-a67c-ac4e972217aa service nova] Creating event network-changed:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 11:54:44.001781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-38d3b08c-c1a0-47ab-af6a-37407fc04115 req-5b2e4ac5-da07-461a-a67c-ac4e972217aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037229 Sep 06 11:54:44.002776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 357/682] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:44.364932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:44.366673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:44.377996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:44.379120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:44.380050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:44.381465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:44.382465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:44.383345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:44.589794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:44.598236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-857c3a6a-6929-4195-b410-f0ac9cf8867f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.256214 Sep 06 11:54:44.598830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 326/683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:44.990211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:44.992157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:44.997053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=10 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:45.015280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:45.016820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:45.017950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:45.019017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:45.019856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:45.020638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:45.192924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:45.202489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3fcd2bc2-5fa3-4f6d-8cad-5ed80f9b4910 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.222208 Sep 06 11:54:45.203082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 358/684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:44 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:45.629359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:45.631511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:45.635745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:45.637749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=10 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:45.649915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:45.650997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:45.651772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:45.653036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:45.653761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:45.654510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:45.832067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:45.841235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71ae1bc6-ad34-4463-b1bb-c53c81500a45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.220551 Sep 06 11:54:45.841858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 327/685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:46.227660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:46.228402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:46.236744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:46.237401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:46.238172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:46.239054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:46.239629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:46.240128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:46.429768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:46.438594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc19bae4-7872-4508-a447-64d6a41c0b7e tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.214954 Sep 06 11:54:46.439835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 359/686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:46 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:46.865248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:46.866531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:46.873350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:46.873882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:46.874325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:46.875085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:46.875536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:46.881454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:47.189493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:47.198994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d80cb02c-8459-4fe7-8d72-836810cf2664 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.338200 Sep 06 11:54:47.200299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 328/687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:47.464852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:47.466855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:47.474223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:47.475110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:47.476127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:47.477051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:47.477637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:47.478194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:47.716800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:47.725216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92608e37-8c96-4d8e-9caa-dc252a95b8ff tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.265680 Sep 06 11:54:47.726188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 360/688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:47 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:47.965568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-093427c9-770e-4cc1-a180-83e13c9d6c1e req-eed8a40e-fe89-4531-a1f6-d2475feea88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cfa4ce-bcd4-42e4-aee4-8af09c9d5487", "name": "network-vif-plugged", "status": "completed", "tag": "0090bdb2-14f0-4900-8ee6-8b7edfe7acea"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:47.976935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-093427c9-770e-4cc1-a180-83e13c9d6c1e req-eed8a40e-fe89-4531-a1f6-d2475feea88c service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:47.977413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-093427c9-770e-4cc1-a180-83e13c9d6c1e req-eed8a40e-fe89-4531-a1f6-d2475feea88c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:47.977894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-093427c9-770e-4cc1-a180-83e13c9d6c1e req-eed8a40e-fe89-4531-a1f6-d2475feea88c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:47.990492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-093427c9-770e-4cc1-a180-83e13c9d6c1e req-eed8a40e-fe89-4531-a1f6-d2475feea88c service nova] Creating event network-vif-plugged:0090bdb2-14f0-4900-8ee6-8b7edfe7acea for instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 on hv-cinder-85604 Sep 06 11:54:47.996550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-093427c9-770e-4cc1-a180-83e13c9d6c1e req-eed8a40e-fe89-4531-a1f6-d2475feea88c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034620 Sep 06 11:54:47.997144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 329/689] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:48.224395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:48.225007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:48.232163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:48.232656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:48.233095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:48.233841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:48.234299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:48.234722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:48.380001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:48.390175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a629fab-dde5-42dd-bc5c-3c2c7006c73d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.169315 Sep 06 11:54:48.390768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 361/690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:48.762675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:48.763375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:48.770203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:48.770648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:48.771084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:48.771793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:48.772346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:48.772994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:48.917053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:48.925160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-293d7e26-1053-4b0b-9bce-d1b399a1e83f tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.166795 Sep 06 11:54:48.925915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 330/691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:48 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:49.414394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:49.415764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:49.422510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:49.422992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:49.423612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:49.424429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:49.424867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:49.425412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:49.446583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:49.579836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:49.594907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-79a25f42-9929-4ae1-b339-19386a2e874a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.184033 Sep 06 11:54:49.595976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 362/692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:49.950580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:49.951196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:49.957591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:49.958115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:49.958558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:49.959304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:49.960625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:49.961059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:50.097990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:50.107324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b5804e4d-6579-4a3b-91c3-287e153ed249 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.160570 Sep 06 11:54:50.107955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 331/693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:49 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:50.618873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:50.619464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:50.626191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:50.630842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:50.630842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:50.630842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:50.630842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:50.631264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:50.763552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:50.771776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b97c98fb-44d3-4afd-8ff8-85732bcd88b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.157137 Sep 06 11:54:50.773434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 363/694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:51.143111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:51.143111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:51.161916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:51.162417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:51.163348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:51.164066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:51.164530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:51.164960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:51.303083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:51.311427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1395be34-cefd-433d-bce9-27f000c4f33d tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.178404 Sep 06 11:54:51.311991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 332/695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:51 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:51.795923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:51.796529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:51.798942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:51.805301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:51.805839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:51.806280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:51.806998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:51.807456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:51.807885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:51.953128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:51.967465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c45f18dc-00bc-4cb2-9545-a7623b60a346 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.175024 Sep 06 11:54:51.968524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 364/696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:52.333808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:52.334525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:52.340839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:52.341326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:52.341792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:52.342493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:52.342949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:52.343461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:52.485048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:52.493934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f1d8517-4c2c-4796-8403-f65d1e665610 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.164143 Sep 06 11:54:52.494885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 333/697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:52 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:52.991724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:52.992398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:52.998980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:52.999447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:52.999885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:53.000572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:53.001023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:53.001450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:53.132819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:53.140794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-14b87f46-0394-407e-aa6d-b688d3125d63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.152913 Sep 06 11:54:53.141366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 365/698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:53.516664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:53.517237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:53.523925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:53.524423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:53.524868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:53.525569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:53.526064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:53.526494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:53.677410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:53.685610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-280e6de4-8ff2-42dd-8b62-b38f10f228c8 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1314 microversion: 2.1 time: 0.173030 Sep 06 11:54:53.686216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 334/699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:53 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:54.164020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:54.164663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:54.171933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:54.172703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:54.173113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:54.173865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:54.174330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:54.174762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:54.254582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-4bbe940c-858c-407a-ab18-a4a2495298ae req-df5faa61-01d2-4c44-a213-db5cad46b4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "name": "network-vif-plugged", "status": "completed", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:54.268957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-4bbe940c-858c-407a-ab18-a4a2495298ae req-df5faa61-01d2-4c44-a213-db5cad46b4f5 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:54.269446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-4bbe940c-858c-407a-ab18-a4a2495298ae req-df5faa61-01d2-4c44-a213-db5cad46b4f5 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:54.269915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-4bbe940c-858c-407a-ab18-a4a2495298ae req-df5faa61-01d2-4c44-a213-db5cad46b4f5 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:54.283424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-4bbe940c-858c-407a-ab18-a4a2495298ae req-df5faa61-01d2-4c44-a213-db5cad46b4f5 service nova] Creating event network-vif-plugged:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 11:54:54.289473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-4bbe940c-858c-407a-ab18-a4a2495298ae req-df5faa61-01d2-4c44-a213-db5cad46b4f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041611 Sep 06 11:54:54.289990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 335/700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:54.386269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:54.395125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e9a51444-72ec-4e40-96f7-998f429d223d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.235054 Sep 06 11:54:54.395814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 366/701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:54.708619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:54.709444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:54.716349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:54.716826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:54.717261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:54.718038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:54.718423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:54.718863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:54.869049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:54.877432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d8852e3e-e3d3-418e-a971-86d254e2c924 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1498 microversion: 2.1 time: 0.173383 Sep 06 11:54:54.878043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 336/702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:54 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:55.420087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:55.420687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:55.427312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:55.427804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:55.429402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:55.429614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:55.430065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:55.430500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:55.522329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:55.523300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:55.530581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:55.531172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:55.531730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:55.533447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:55.533662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:55.534373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:55.541576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:55.567032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:54:55.618500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:55.635191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21c6c3c3-45fa-416e-9954-03343ef71ad4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.218818 Sep 06 11:54:55.636813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 367/703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:55.669212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:55.701574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d39e170c-866d-4ddd-8564-1ffb8396ad68 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "DELETE /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 204 len: 0 microversion: 2.1 time: 0.184485 Sep 06 11:54:55.702772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 337/704] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 11:54:55 2022] DELETE /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:54:55.715062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:55.716065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:55.722553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:55.723056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:55.723501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:55.724206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:55.724663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:55.725386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:55.894289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:55.903158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-26a67026-53ba-4e3b-97ec-324a8e37d672 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1504 microversion: 2.1 time: 0.195841 Sep 06 11:54:55.903745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 368/705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:55 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:56.675910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:56.676811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:56.682966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.683462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.683901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:56.684639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.685098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.685522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:56.879905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:56.890429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac13f6ac-5906-4fb4-97f0-bc4d215c0ae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1369 microversion: 2.1 time: 0.218941 Sep 06 11:54:56.891417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 338/706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:56.928735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:56.929453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:56.936230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.936816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.937316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:56.938199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:56.938862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:56.939426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:57.095998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:57.105191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aaab2ec1-ece1-4441-918d-f78f785d15c5 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1504 microversion: 2.1 time: 0.180713 Sep 06 11:54:57.106104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 369/707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:56 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:57.918308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:57.919278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:57.937883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:57.937883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:57.937883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:57.937883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:57.938272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:57.938272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.077835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:58.086714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-36b3fb59-2323-4e75-8d57-402ee6b37a3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1564 microversion: 2.1 time: 0.173068 Sep 06 11:54:58.087309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 339/708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:58.109662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:58.110362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:58.117392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:58.117926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:58.118371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.119076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:58.119537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:58.119981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.128376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:58.128983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:58.136673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:58.137182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:58.137616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.138341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:58.138797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:58.139223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:58.203666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ce7fbe54-0ce5-4c67-90f3-ddd255727fd0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096966 Sep 06 11:54:58.203666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 370/709] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 11:54:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:54:58.286019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:58.294969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d905dc7f-5a22-4de6-9070-d72ffe8f7151 tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1504 microversion: 2.1 time: 0.170345 Sep 06 11:54:58.295630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 340/710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:58 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:54:59.319292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:54:59.319951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:54:59.326302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:59.326793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:59.327234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:59.327937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:59.328396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:59.328896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:59.833754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:54:59.847220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-8a020d3e-db90-406d-8912-bc81fdea90bb req-41603509-1023-4cdb-badd-c59f12f40897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:54:59.856560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-457a1e80-cf57-45f5-b439-fbf15f91b3da tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1504 microversion: 2.1 time: 0.541619 Sep 06 11:54:59.860043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 371/711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:54:59 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:54:59.868072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-8a020d3e-db90-406d-8912-bc81fdea90bb req-41603509-1023-4cdb-badd-c59f12f40897 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:54:59.868929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-8a020d3e-db90-406d-8912-bc81fdea90bb req-41603509-1023-4cdb-badd-c59f12f40897 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:54:59.869447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-8a020d3e-db90-406d-8912-bc81fdea90bb req-41603509-1023-4cdb-badd-c59f12f40897 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:54:59.883351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-8a020d3e-db90-406d-8912-bc81fdea90bb req-41603509-1023-4cdb-badd-c59f12f40897 service nova] Creating event network-changed:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 11:54:59.890683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-8a020d3e-db90-406d-8912-bc81fdea90bb req-41603509-1023-4cdb-badd-c59f12f40897 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047110 Sep 06 11:54:59.891692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 341/712] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:00.264364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1360810309", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "networks": [{"uuid": "20d96228-f9ba-4111-a17c-85b905e1e49f"}]}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:00.335865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] validate_networks() for [('20d96228-f9ba-4111-a17c-85b905e1e49f', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:55:00.804505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:55:00.804929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:55:00.805410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:55:00.805860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:55:00.806274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:55:00.816010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.816487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.816918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.817661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.818129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.818609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.839540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Getting quotas for project 223f7e0f4ea74b398aad606cf1e7c150. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:55:00.844796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Getting quotas for user 317022dc9f1d46cbbe7190edd7832e43 and project 223f7e0f4ea74b398aad606cf1e7c150. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:55:00.860631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:55:00.863342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:55:00.895696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:00.898237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:00.908389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.909364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.910279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.911208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.912723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.913570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.916626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b76cca94-3a32-4453-9ed3-4f99c2675b60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662235 Sep 06 11:55:00.918015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 372/713] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 11:55:00.933066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f291e76f-0200-42bb-b906-5cb2454bbc00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:00.934542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f291e76f-0200-42bb-b906-5cb2454bbc00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:00.976272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:00.976614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:00.977056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:00.977515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lazy-loading 'fault' on Instance uuid 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:55:01.000133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f291e76f-0200-42bb-b906-5cb2454bbc00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:01.023032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f291e76f-0200-42bb-b906-5cb2454bbc00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1219 microversion: 2.1 time: 0.096484 Sep 06 11:55:01.029090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 373/714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:00 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:01.050865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a597decac02943339b9909d41020d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474d58de54cb4c44ab3885e9a2943a0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:01.059816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-983ab3ef-c8c3-489d-88f8-0c7375a7d3de tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 200 len: 1304 microversion: 2.1 time: 0.170979 Sep 06 11:55:01.060408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 342/715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:00 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:01.909637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-a610a0c9-01ee-421f-ba65-6857da600bd8 req-6a7c5a30-d172-4e4b-9f6c-60278cd84827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cfa4ce-bcd4-42e4-aee4-8af09c9d5487", "name": "network-vif-deleted", "tag": "0090bdb2-14f0-4900-8ee6-8b7edfe7acea"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:01.921161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-a610a0c9-01ee-421f-ba65-6857da600bd8 req-6a7c5a30-d172-4e4b-9f6c-60278cd84827 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:01.921636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-a610a0c9-01ee-421f-ba65-6857da600bd8 req-6a7c5a30-d172-4e4b-9f6c-60278cd84827 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:01.922429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-a610a0c9-01ee-421f-ba65-6857da600bd8 req-6a7c5a30-d172-4e4b-9f6c-60278cd84827 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:01.935645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-a610a0c9-01ee-421f-ba65-6857da600bd8 req-6a7c5a30-d172-4e4b-9f6c-60278cd84827 service nova] Creating event network-vif-deleted:0090bdb2-14f0-4900-8ee6-8b7edfe7acea for instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 on hv-cinder-85604 Sep 06 11:55:01.940883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-a610a0c9-01ee-421f-ba65-6857da600bd8 req-6a7c5a30-d172-4e4b-9f6c-60278cd84827 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034826 Sep 06 11:55:01.941475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 374/716] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:02.047653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:02.048194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:02.055555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:02.056363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:02.056806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:02.057610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:02.058140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:02.058672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:02.087380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:02.088220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] [instance: 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:02.100845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:02.101801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:02.102248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:02.102977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:02.103443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:02.103880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:02.119602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] HTTP exception thrown: Instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 could not be found. Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Request method failure captured: Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 HTTP/1.1 Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzR9V0R0DSCJqXLX2bwOX3C57a5CALnuU0uRn6hVFCJA2DHsWPmBKmzmxM6qSW5zRJ2V7sxhh_jDasSOQ_iaTtb6a6xAqe9qPyAGeDkk37xg7czvHip3loyUN9Iu3ClH7DE0ghWOfxNjGHQ4FUndA6IgXOiRhavWA6k2UkqsUQnifPI Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 474d58de54cb4c44ab3885e9a2943a0c Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesActionsTest-750696358 Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:55:02.121330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/474d58de54cb4c44ab3885e9a2943a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/474d58de54cb4c44ab3885e9a2943a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_474d58de54cb4c44ab3885e9a2943a0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/474d58de54cb4c44ab3885e9a2943a0c"}]}] Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesActionsTest-750696358 Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 474d58de54cb4c44ab3885e9a2943a0c Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesActionsTest-750696358 Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesActionsTest-750696358-project Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: a597decac02943339b9909d41020d8c7 Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesActionsTest-750696358-project Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 could not be found. Sep 06 11:55:02.122926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '74cfa4ce-bcd4-42e4-aee4-8af09c9d5487'} Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 could not be found. Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:55:02.123812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 could not be found. Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 could not be found. Sep 06 11:55:02.125151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:55:02.126512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] Returning 404 to user: Instance 74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:55:02.126512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8c270f95-6370-496d-9381-9105337d4a9b tempest-VolumesActionsTest-750696358 tempest-VolumesActionsTest-750696358-project] 10.222.0.18 "GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487" status: 404 len: 111 microversion: 2.1 time: 0.040570 Sep 06 11:55:02.126512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 375/717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:02 2022] GET /compute/v2.1/servers/74cfa4ce-bcd4-42e4-aee4-8af09c9d5487 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:55:02.134755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:02.146197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ea4e544-9903-44d8-a918-01fe19fa2fdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1271 microversion: 2.1 time: 0.102149 Sep 06 11:55:02.147309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 343/718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:02 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:03.170772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:03.171435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:03.177535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:03.178716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:03.179157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:03.180041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:03.180508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:03.181121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:03.327513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:03.335687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a95048e1-7731-4a69-87ec-652c22172d22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.169312 Sep 06 11:55:03.336213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 376/719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:03 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:03.672210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:03.674985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:03.683605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:03.684202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:03.684776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:03.685499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:03.685992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:03.686424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:04.102244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-ad57d91d-ffa7-4187-aa37-cce81f256c21 req-a154a8bf-12ff-4c89-adb3-c0b50baee815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4095e6-5648-4099-9d9e-bbaf5231295d", "tag": "d2e9a927-00af-4515-98c2-3c03e430986a"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:04.111817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-ad57d91d-ffa7-4187-aa37-cce81f256c21 req-a154a8bf-12ff-4c89-adb3-c0b50baee815 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:04.112374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-ad57d91d-ffa7-4187-aa37-cce81f256c21 req-a154a8bf-12ff-4c89-adb3-c0b50baee815 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:04.112903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-ad57d91d-ffa7-4187-aa37-cce81f256c21 req-a154a8bf-12ff-4c89-adb3-c0b50baee815 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:04.125072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-ad57d91d-ffa7-4187-aa37-cce81f256c21 req-a154a8bf-12ff-4c89-adb3-c0b50baee815 service nova] Creating event network-changed:d2e9a927-00af-4515-98c2-3c03e430986a for instance 1f4095e6-5648-4099-9d9e-bbaf5231295d on hv-cinder-85604 Sep 06 11:55:04.129945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-ad57d91d-ffa7-4187-aa37-cce81f256c21 req-a154a8bf-12ff-4c89-adb3-c0b50baee815 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031817 Sep 06 11:55:04.130701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 377/720] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:04.360396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:04.361101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:04.368146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:04.368636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:04.369074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:04.369798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:04.370257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:04.370681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:04.514238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:04.522368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e10e65c1-87c5-4f93-b4fc-a0a1911f59dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.166676 Sep 06 11:55:04.522919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 378/721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:04 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:05.545882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:05.546576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:05.553397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:05.554088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:05.554522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:05.555205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:05.555655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:05.556072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:05.692412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:05.701139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4e34120-e9a9-44c6-b4cb-63341097aae7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.159209 Sep 06 11:55:05.701733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 379/722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:05 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:06.723814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:06.725014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:06.731344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:06.731820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:06.732247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:06.732925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:06.733370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:06.733820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:06.865137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:06.873174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-48f795e5-a391-4d74-a240-777a6bd6e69a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.153212 Sep 06 11:55:06.873763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 380/723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:06 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:07.297763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc4fb8dc-aa2d-4877-801c-1bebf5ed399a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action" status: 200 len: 28614 microversion: 2.20 time: 3.629653 Sep 06 11:55:07.298400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 344/724] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 6 11:55:03 2022] POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action => generated 28614 bytes in 3631 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:55:07.896818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:07.897674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:07.904003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:07.904497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:07.904937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:07.905674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:07.906126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:07.906551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:08.039125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:08.047393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92c44df2-73e3-4b1e-b4ee-e999d6566e20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.154796 Sep 06 11:55:08.047922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 381/725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:07 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:09.072179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:09.073168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:09.082215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:09.082708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:09.083381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:09.085047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:09.085410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:09.085914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:09.272057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:09.281273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-049fd70a-2235-4ca2-8acd-ec69fd760091 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.214066 Sep 06 11:55:09.282273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 345/726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:09 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:10.304995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:10.305698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:10.312192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:10.312684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:10.313122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:10.313858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:10.314315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:10.314974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:10.473120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:10.481534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6e6d0fbd-6791-412a-8f7c-ed75d01d1c3c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.180878 Sep 06 11:55:10.482701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 382/727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:10 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:11.504888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:11.505467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:11.512809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:11.513295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:11.513763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:11.514663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:11.515552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:11.516139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:11.664754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:11.673171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-55224f5e-2828-45c1-a2e9-2eddd4730c06 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.172436 Sep 06 11:55:11.673910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 346/728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:11 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:12.696903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:12.697689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:12.700781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:12.701926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=8 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:12.708213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:12.709081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:12.709965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:12.710930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:12.711573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:12.712238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:12.718068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:12.857734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:12.869537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-674d4be2-bdb9-429d-beb4-e97a1ff2d075 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.176686 Sep 06 11:55:12.870326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 383/729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:12 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:13.897060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:13.899287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:13.909408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:13.910393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:13.911223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:13.913337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:13.914000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:13.914732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:14.086797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:14.096168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-793f4a1c-7cc8-470d-b113-1e7d05ed2e71 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.206294 Sep 06 11:55:14.097184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 347/730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:13 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:14.385530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:14.389041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:14.396848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:14.397953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:14.398493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:14.399317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:14.399858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:14.400405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:14.555851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-13f8c9df-de22-49c3-89fa-86bf50d0d4ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action" status: 200 len: 29036 microversion: 2.1 time: 0.175040 Sep 06 11:55:14.561400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 384/731] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:55:14 2022] POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action => generated 29036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:55:15.125631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:15.127532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:15.135980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:15.136547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:15.137306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:15.138374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:15.138937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:15.139731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:15.269307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-e7e6d949-f11f-4963-bc50-545cc87347e5 req-a6be0ebf-e965-4243-afc1-bead8b3696f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4095e6-5648-4099-9d9e-bbaf5231295d", "name": "network-vif-plugged", "status": "completed", "tag": "d2e9a927-00af-4515-98c2-3c03e430986a"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:15.291604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-e7e6d949-f11f-4963-bc50-545cc87347e5 req-a6be0ebf-e965-4243-afc1-bead8b3696f6 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:15.292415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-e7e6d949-f11f-4963-bc50-545cc87347e5 req-a6be0ebf-e965-4243-afc1-bead8b3696f6 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:15.293097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-e7e6d949-f11f-4963-bc50-545cc87347e5 req-a6be0ebf-e965-4243-afc1-bead8b3696f6 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:15.320417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-e7e6d949-f11f-4963-bc50-545cc87347e5 req-a6be0ebf-e965-4243-afc1-bead8b3696f6 service nova] Creating event network-vif-plugged:d2e9a927-00af-4515-98c2-3c03e430986a for instance 1f4095e6-5648-4099-9d9e-bbaf5231295d on hv-cinder-85604 Sep 06 11:55:15.332964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-e7e6d949-f11f-4963-bc50-545cc87347e5 req-a6be0ebf-e965-4243-afc1-bead8b3696f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068163 Sep 06 11:55:15.337212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 385/732] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:15.433406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:15.448011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3be836f8-6f9b-4d32-990a-b4a78f568fee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.329278 Sep 06 11:55:15.449546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 348/733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:15 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:16.438272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:16.441415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:16.448882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:16.449747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:16.450410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:16.451310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:16.451988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:16.452502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:16.476856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:16.477769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:16.495294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:16.497245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:16.498342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:16.499879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:16.500984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:16.502240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:16.640417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f3ae45c6-47ce-43ca-80a1-f6893d767cdd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/action" status: 200 len: 29047 microversion: 2.1 time: 0.206721 Sep 06 11:55:16.641039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 386/734] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:55:16 2022] POST /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/action => generated 29047 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:55:16.676022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:16.686543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d738cddf-7956-4b73-9065-d893657282e4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.215082 Sep 06 11:55:16.697729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 349/735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:16 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:17.712660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:17.713480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:17.720827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:17.721451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:17.722231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:17.723031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:17.723590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:17.724777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:17.903164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:17.915490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b3f51ac-1f5e-4c42-8d4c-ec18b7362bf6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1319 microversion: 2.1 time: 0.207144 Sep 06 11:55:17.916854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 387/736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:17 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:55:18.940098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:18.940880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:18.948624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:18.949282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:18.949881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:18.950491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:18.950969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:18.951634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:19.138036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:19.151873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3b7eb1e5-9cb0-4f23-889c-ecc125883622 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1507 microversion: 2.1 time: 0.215769 Sep 06 11:55:19.152493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 350/737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:55:18 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:55:30.418353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:30.419265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=20 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:30.610310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:30.611043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:30.617623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:30.618149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:30.618620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:30.619330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:30.619810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:30.620235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:30.646006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-785a1fce-0673-46db-8a0a-1a66c86e401d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/ips" status: 200 len: 152 microversion: 2.20 time: 0.234436 Sep 06 11:55:30.646430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 388/738] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Sep 6 11:55:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/ips => generated 152 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:55:33.095839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:33.096576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:33.283645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:33.284143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:33.291255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.291744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.292237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.292945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.293471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.293919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.318951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d042b5df-36f6-4eb9-9756-4dab413d87b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/ips" status: 200 len: 151 microversion: 2.1 time: 0.228616 Sep 06 11:55:33.319556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 351/739] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 11:55:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/ips => generated 151 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:33.770920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:33.771518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:33.779010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.779490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.779922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.780608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:33.781060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:33.781479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:33.804608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lazy-loading 'flavor' on Instance uuid 0878a748-0471-4506-b2e8-7b3d85289c54 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:55:34.118274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-870e1088-0ceb-47f4-b6a1-eb80e4b1cea4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action" status: 202 len: 0 microversion: 2.20 time: 0.350375 Sep 06 11:55:34.118956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 389/740] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 6 11:55:33 2022] POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:55:34.128981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:34.129601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:34.137247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:34.137797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:34.138314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:34.140497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:34.140999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:34.141468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:34.395494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:34.403849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:34.405302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:34.406493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f709cce-1426-473b-8196-ad500cdcb51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.282542 Sep 06 11:55:34.407117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 352/741] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:35.433949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:35.434690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:35.440883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:35.441369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:35.441840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:35.442533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:35.442991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:35.443414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:35.584366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:35.592667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:35.594261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:35.595508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-44971387-2c4d-4646-ba33-7586df485a97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.166899 Sep 06 11:55:35.596085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 390/742] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:35.767134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a016920c-b2b3-4b24-9fda-8978dc638daf"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:35.769580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:35.776566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:35.777048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:35.777488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:35.778290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:35.778751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:35.779178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:36.106404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-739104c0-5be3-4bfe-9d44-18877a43d86a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343329 Sep 06 11:55:36.107031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 353/743] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:55:35 2022] POST /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:36.621879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:36.622853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:36.630277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:36.630970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:36.631676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:36.632532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:36.633123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:36.633637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:36.772197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:36.780504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:36.781959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:36.783116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c768c43b-ddd3-4476-bd69-8d0231243086 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.166634 Sep 06 11:55:36.783670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 391/744] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:37.713431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:37.714030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:37.720398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:37.720895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:37.721403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:37.722141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:37.722488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:37.722977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:37.746561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0f0cbb7-e3f4-4960-a2cd-5ed297f441f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/ips" status: 200 len: 145 microversion: 2.1 time: 0.141105 Sep 06 11:55:37.747121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 354/745] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 11:55:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/ips => generated 145 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:55:37.808601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:37.809212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:37.815552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:37.816016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:37.816449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:37.817127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:37.817578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:37.818032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:37.958220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:37.967111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:37.968539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:37.969721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6cd8d6c-10e6-4bb9-ab34-80bc1e6ce3ae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.165220 Sep 06 11:55:37.970280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 392/746] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:38.995482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:38.996049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:39.002479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:39.002959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:39.003397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:39.004083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:39.004536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:39.004958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:39.134477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:39.143760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:39.145212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:39.146408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c818cde6-8dbd-434d-8ec7-7cd047a643c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.155037 Sep 06 11:55:39.146963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 355/747] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:40.172741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:40.173327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:40.180222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:40.180797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:40.181235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:40.182045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:40.182599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:40.183086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:40.318780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:40.328169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:40.329611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:40.330796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-13d17b8e-8e06-4af9-905e-2367e3901c24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.162014 Sep 06 11:55:40.331401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 393/748] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:41.359133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:41.359752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:41.366403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:41.366902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:41.367339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:41.368034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:41.368491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:41.368911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:41.511992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:41.520203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:41.521657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:41.522822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62defe2d-9aa4-4939-90cf-4f034261b308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.171036 Sep 06 11:55:41.523818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 356/749] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:42.549893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:42.550486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:42.557450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:42.558191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:42.558736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:42.559463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:42.559925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:42.560420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:42.693051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:42.701116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:42.702578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:42.703741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7b761915-2b50-41a9-a3c2-9416a970b984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.157785 Sep 06 11:55:42.704301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 394/750] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:42.878448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c96da1c3-436a-4ff1-902a-4bcaf06e7add"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:55:42.880848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:42.887359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:42.887851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:42.888291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:42.889073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:42.889535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:42.890247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:43.255909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fee32234-09e0-43f3-b6fa-31c4a4726944 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381033 Sep 06 11:55:43.256818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 357/751] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:55:42 2022] POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:55:43.730314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:43.730917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:43.737395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:43.737916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:43.738358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:43.739050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:43.739512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:43.739943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:43.873192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:43.881001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:43.882459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:43.883614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-05f234c2-8140-4b5a-9326-2f5c3c88b9dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.157266 Sep 06 11:55:43.884168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 395/752] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:44.911547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:44.912251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:44.918527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:44.919012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:44.920035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:44.920781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:44.921238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:44.921684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:45.055333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:45.064553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:45.066065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:45.067272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3d5466c5-2960-4f18-bbc7-af46839df975 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.160493 Sep 06 11:55:45.067839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 358/753] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:46.092825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:46.093443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:46.099875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:46.100370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:46.100809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:46.101508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:46.102000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:46.102550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:46.237121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:46.245158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:46.246669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:46.248562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4428526e-055e-4910-8f1c-2be5d476472d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.160012 Sep 06 11:55:46.249192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 396/754] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:47.274781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:47.275340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:47.282077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:47.282564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:47.283006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:47.283694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:47.284150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:47.284578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:47.418599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:47.426797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:47.428215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:47.429368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-497a7225-a620-458f-ad19-ce14e704f34c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.159128 Sep 06 11:55:47.429995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 359/755] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:48.455273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:48.455955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:48.462737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:48.463228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:48.463667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:48.464372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:48.464836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:48.465262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:48.600628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:48.609517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:48.610903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:48.612066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e07c52ab-9756-4721-b191-dab21bbdcd03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.160782 Sep 06 11:55:48.612634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 397/756] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:49.640456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:49.641103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:49.647674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:49.648220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:49.648653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:49.649410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:49.649818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:49.650242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:49.783370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:49.791660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:49.793086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:49.794831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-879f5fe5-98c5-4d5e-bee9-1922665d129a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.160398 Sep 06 11:55:49.795430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 360/757] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:50.820577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:50.821128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:50.827771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:50.828252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:50.828685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:50.829365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:50.829850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:50.830272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:50.965053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:50.973442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:50.974937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:50.976101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ae0c57a-5654-4502-aeb6-e3e8ebfffe76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.159492 Sep 06 11:55:50.976826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 398/758] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:52.002054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:52.002673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:52.009573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:52.010380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:52.010819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:52.011519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:52.011972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:52.012396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:52.151330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:52.162230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:52.164055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:52.165237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c62fd4ad-4e31-4bd4-84af-b099e13bc8bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.167254 Sep 06 11:55:52.165830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 361/759] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:53.190787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:53.191397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:53.198059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:53.198548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:53.199006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:53.199705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:53.200161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:53.200590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:53.340147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:53.348915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:53.350408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:53.351585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-263568d7-9bc4-42c8-a60e-b6c241088be8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.164810 Sep 06 11:55:53.352143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 399/760] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:54.377728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:54.378330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:54.385165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:54.385674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:54.386118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:54.386818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:54.387640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:54.388128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:54.517675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:54.525877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:54.527336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:54.528603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b489575a-8418-422a-8c28-691dcde4a86b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.155066 Sep 06 11:55:54.529061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 362/761] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:55.555539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:55.555539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:55.563171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:55.563672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:55.564114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:55.565062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:55.565550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:55.566019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:55.712495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:55.721107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:55.722649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:55.723897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71d2d608-9484-4eaa-9f66-35b8dd442c73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.172985 Sep 06 11:55:55.724443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 400/762] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:56.749462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:56.750203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:56.757175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:56.757659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:56.758100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:56.758777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:56.759222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:56.759640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:56.891133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:56.898996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:56.900422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:56.901561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a17fb603-24e6-4ff6-90e7-6011a3fe70da tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.156001 Sep 06 11:55:56.902185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 363/763] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:57.935547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:57.936228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:57.943596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:57.944153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:57.944595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:57.945292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:57.945778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:57.946210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:58.079722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:58.088047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:58.089499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:58.090693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-54cede41-6a6f-4cc1-a353-05761c0a2645 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.159594 Sep 06 11:55:58.091259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 401/764] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:55:59.116285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:55:59.116928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:55:59.123419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:59.123899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:59.124330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:59.125784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:55:59.126253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:55:59.126681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:55:59.263108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:59.272256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:59.273750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:55:59.274899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7e8126bb-5d1e-40b1-b9d7-4ae80e93ef2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.162568 Sep 06 11:55:59.275467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 364/765] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:55:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:00.301251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:00.301893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:00.311613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:00.312505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:00.313316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:00.314634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:00.315484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:00.316319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:00.450758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:00.453057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:00.462053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:00.463503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:00.464676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2bfb9bc5-a413-43ed-b5ab-7a6905749911 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.168215 Sep 06 11:56:00.465235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 402/766] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:01.492509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:01.493282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:01.500268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:01.500753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:01.502050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:01.502784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:01.503273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:01.503708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:01.525248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:01.669147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:01.678568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:01.680020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:01.681204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69226e84-bf7b-4df4-bb53-ec8bc2f2ad0b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.193337 Sep 06 11:56:01.681791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 365/767] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:02.709778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:02.710398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:02.713150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=31 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:02.718938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:02.719427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:02.720024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:02.721885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:02.722349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:02.722779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:02.857988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:02.866318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:02.867752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:02.868908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8af13bb8-8c6f-4679-a54e-578d8d525aec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.163085 Sep 06 11:56:02.869470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 403/768] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:03.806713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d3622ace-6521-43da-8c74-160ab4f22802 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: .version_select at 0x7f97f5009280>, body: {"keypair": {"name": "tempest-keypair-298295942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvJ3bbGpCWhQ++tzr+kKB9Okns7bPx61m5jgTY9lF5Wf2v59I6TNujx79NggxqOjoycJRi/b74L9ECmgQAjcicKbzGMYLfVNYejbyhIwgTmDi1AwlstteVfSnfQU0DNzw=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:03.812514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=31 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:03.824075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-d3622ace-6521-43da-8c74-160ab4f22802 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:56:03.827979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-d3622ace-6521-43da-8c74-160ab4f22802 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:56:03.855227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d3622ace-6521-43da-8c74-160ab4f22802 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052410 Sep 06 11:56:03.855839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 366/769] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 11:56:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:03.895096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:03.895873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:03.902664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:03.903156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:03.903591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:03.904357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:03.905023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:03.905447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:04.106204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:04.115371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:04.116830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:04.118037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a57ee9bf-71cb-4395-b30d-cf46cc39c949 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.228025 Sep 06 11:56:04.119217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 404/770] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:05.148199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:05.149148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:05.156864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:05.157410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:05.158147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:05.159281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:05.165128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:05.165598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:05.264967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-672335655", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cda860d2-2fe0-49d5-8510-1c9e43ecbe57"}], "security_groups": [{"name": "tempest-securitygroup--1728264800"}], "key_name": "tempest-keypair-298295942", "user_data": "}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:05.306059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:05.315643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:05.317095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:05.318364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d412ba76-88b5-4aca-a5e8-1aa16271234b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.177283 Sep 06 11:56:05.319037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 367/771] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:05.377012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] validate_networks() for [('cda860d2-2fe0-49d5-8510-1c9e43ecbe57', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:56:05.894019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:56:05.894448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:56:05.894952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:56:05.895362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:56:05.895775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:56:05.905111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:05.905591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:05.906094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:05.906834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:05.907310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:05.907723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:05.926398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:56:05.930827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:56:05.943533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:56:05.946118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:56:05.999145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c6f84dfd-e1f4-48f2-bcb2-b63b6b230f33 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738823 Sep 06 11:56:05.999825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 405/772] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:56:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:56:06.011855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-feb84a2b-fd1b-4fcc-9278-a03999858aab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:06.012414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-feb84a2b-fd1b-4fcc-9278-a03999858aab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:06.069905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-feb84a2b-fd1b-4fcc-9278-a03999858aab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:06.076892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-feb84a2b-fd1b-4fcc-9278-a03999858aab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1240 microversion: 2.1 time: 0.069015 Sep 06 11:56:06.077482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 368/773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:06 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:06.345910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:06.346752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:06.354947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:06.356547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:06.361004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:06.362116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:06.362826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:06.363620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:06.504294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:06.512715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:06.514199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:06.515643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8bc80443-548a-457e-82a7-f7dbc202c88b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1723 microversion: 2.20 time: 0.174959 Sep 06 11:56:06.516210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 406/774] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:07.101689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:07.102326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:07.111762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:07.112468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:07.113156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:07.114376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:07.115216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:07.115986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:07.188111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:07.197481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-96f6626e-192d-4453-9584-34c532dab238 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1292 microversion: 2.1 time: 0.100196 Sep 06 11:56:07.198116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 369/775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:07 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:07.541317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:07.541997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:07.553636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:07.554163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:07.554604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:07.555405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:07.555872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:07.556338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:07.759608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:07.769395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:07.770916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:07.772185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-81dc8811-5f7f-40b0-a705-34023eb6dbf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.235366 Sep 06 11:56:07.773002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 407/776] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:08.221538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:08.222223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:08.228918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:08.229403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:08.229868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:08.230562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:08.231023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:08.231441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:08.312967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:08.321857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69c0c705-79bb-403a-892d-6ccf580a5fe6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1298 microversion: 2.1 time: 0.104061 Sep 06 11:56:08.322772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 370/777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:08 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:08.559687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75c0af2e-8dce-463e-a57f-37b7ea3a460e", "device": "/dev/sdb"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:08.564823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:08.571939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:08.572443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:08.572880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:08.573587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:08.574067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:08.574490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:08.799846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:08.800793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:08.810892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:08.811394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:08.811829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:08.826690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:08.827188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:08.827638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:08.948374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-280bea27-43b0-427d-8adb-99a434c52364 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "POST /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395332 Sep 06 11:56:08.949028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 408/778] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:56:08 2022] POST /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:09.321075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:09.330728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:09.332224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:09.333702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62d460d0-88a9-4f86-aeb3-27ea73a1a685 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.538167 Sep 06 11:56:09.334538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 371/779] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:09.350678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:09.352433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:09.362023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:09.362293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:09.362573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:09.366353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:09.366353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:09.366353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:09.542154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:09.552599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cbd86098-1ebe-40d0-bcf9-28c7f301bdc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.209388 Sep 06 11:56:09.553474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 409/780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:09 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:09.828963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-f4d4fc92-43cb-4033-b5c4-f8d99ae4b9af req-2044aab2-b27f-46fb-9e91-9b47d2fd5e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "name": "network-vif-plugged", "status": "completed", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:09.842817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-f4d4fc92-43cb-4033-b5c4-f8d99ae4b9af req-2044aab2-b27f-46fb-9e91-9b47d2fd5e7f service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:09.843210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-f4d4fc92-43cb-4033-b5c4-f8d99ae4b9af req-2044aab2-b27f-46fb-9e91-9b47d2fd5e7f service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:09.843749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-f4d4fc92-43cb-4033-b5c4-f8d99ae4b9af req-2044aab2-b27f-46fb-9e91-9b47d2fd5e7f service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:09.859055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-f4d4fc92-43cb-4033-b5c4-f8d99ae4b9af req-2044aab2-b27f-46fb-9e91-9b47d2fd5e7f service nova] Creating event network-vif-plugged:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 11:56:09.865741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-f4d4fc92-43cb-4033-b5c4-f8d99ae4b9af req-2044aab2-b27f-46fb-9e91-9b47d2fd5e7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196957 Sep 06 11:56:09.866336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 372/781] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:09.874762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-6fba48bd-9090-4708-9d86-8a1692068c8a req-8af6cbe1-6c8b-4881-970c-33a0552f023c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde6a07d-6352-44f1-9e8d-84babe614815", "tag": "f9f8a407-fbad-4bfe-90d0-a44badb4b76b"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:09.885735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-6fba48bd-9090-4708-9d86-8a1692068c8a req-8af6cbe1-6c8b-4881-970c-33a0552f023c service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:09.886215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-6fba48bd-9090-4708-9d86-8a1692068c8a req-8af6cbe1-6c8b-4881-970c-33a0552f023c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:09.886645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-6fba48bd-9090-4708-9d86-8a1692068c8a req-8af6cbe1-6c8b-4881-970c-33a0552f023c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:09.900118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-6fba48bd-9090-4708-9d86-8a1692068c8a req-8af6cbe1-6c8b-4881-970c-33a0552f023c service nova] Creating event network-changed:f9f8a407-fbad-4bfe-90d0-a44badb4b76b for instance cde6a07d-6352-44f1-9e8d-84babe614815 on hv-cinder-85604 Sep 06 11:56:09.905217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-6fba48bd-9090-4708-9d86-8a1692068c8a req-8af6cbe1-6c8b-4881-970c-33a0552f023c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111715 Sep 06 11:56:09.905531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 410/782] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:56:10.359664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:10.360884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:10.369177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:10.369678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:10.370127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:10.370819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:10.371265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:10.371688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:10.524067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:10.533003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:10.534487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:10.535659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ccc825f-cdd2-4bba-9e89-5ae47575fdd1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.181019 Sep 06 11:56:10.536241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 373/783] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:10.576381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:10.577179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:10.584269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:10.584756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:10.585197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:10.585928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:10.586388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:10.586818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:10.721827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:10.729681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0a4187ce-e1d0-4c70-b99b-8cb6b5e5a805 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.157487 Sep 06 11:56:10.730261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 411/784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:10 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:11.562156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:11.563141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:11.571605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:11.572193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:11.572707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:11.573503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:11.574071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:11.574571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:11.754250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:11.755118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:11.761994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:11.762474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:11.763090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:11.763958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:11.764827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:11.765256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:11.785502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:11.795628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:11.797308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:11.799381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a9e32890-e8f2-4822-a239-8b7fa8a4b3c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.241594 Sep 06 11:56:11.809001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 374/785] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:11.923279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:11.931211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6545c721-3d88-4014-b2a9-03f90f2c262f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.182482 Sep 06 11:56:11.931803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 412/786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:11 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:12.114336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa214cab-0fab-4cdf-b5db-d9193b3fc47d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:12.120424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa214cab-0fab-4cdf-b5db-d9193b3fc47d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.120920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa214cab-0fab-4cdf-b5db-d9193b3fc47d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.121385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa214cab-0fab-4cdf-b5db-d9193b3fc47d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.185730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa214cab-0fab-4cdf-b5db-d9193b3fc47d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Going to try to stop instance {{(pid=127121) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 11:56:12.252845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa214cab-0fab-4cdf-b5db-d9193b3fc47d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action" status: 202 len: 0 microversion: 2.1 time: 0.144156 Sep 06 11:56:12.253664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 375/787] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:56:12 2022] POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:56:12.261919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:12.262573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:12.269429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.269954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.270392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.271093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.271552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.271977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.426547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:12.434848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a192c831-68c5-42c6-a5e6-d9b2f0b018e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.176811 Sep 06 11:56:12.435417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 413/788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:12.826920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:12.827618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:12.834986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.835608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.836093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.837052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.837284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.837746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.955538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:12.956123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:12.962565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.963050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.963486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.964192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:12.964654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:12.965086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:12.974539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:12.983307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:12.984773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:12.986223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b7cf603-646b-46df-acab-564a8a8945d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.163842 Sep 06 11:56:12.986579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 376/789] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:13.107042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:13.116503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c4abbedb-1c33-4e12-873c-01aeb4861cea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.165714 Sep 06 11:56:13.117095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 414/790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:12 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:13.459653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:13.460304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:13.466283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:13.466762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:13.467197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:13.467894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:13.468351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:13.468786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:13.602669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:13.611848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9a4408d4-ddc5-427c-9d2f-9fd440a4463c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.155957 Sep 06 11:56:13.612442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 377/791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:14.012390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:14.012997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:14.020690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:14.021219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:14.021684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:14.022386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:14.023058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:14.023510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:14.140114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:14.140728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:14.148547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:14.149033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:14.149470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:14.150192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:14.150649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:14.151179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:14.160131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:14.169431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:14.171014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:14.172277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-451a493b-aed1-446e-a189-5ae1280fa921 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.163798 Sep 06 11:56:14.173128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 415/792] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:14.293391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:14.301058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-207861bb-faa5-4d0c-bd47-10472927f46d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.165067 Sep 06 11:56:14.301624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 378/793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:14 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:14.636271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:14.636795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:14.643066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:14.643550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:14.643994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:14.644728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:14.645151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:14.645575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:14.774806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:14.784101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dfb5c9c6-41ba-4d16-bcfe-932b8551cea6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.151699 Sep 06 11:56:14.784685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 416/794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:15.198086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:15.198685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:15.205792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:15.206274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:15.206701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:15.207384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:15.207829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:15.208241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:15.323918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:15.324522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:15.331245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:15.331732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:15.332164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:15.332859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:15.333306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:15.333773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:15.341830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:15.350775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:15.352218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:15.353386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5b02e7b9-355f-4c6d-a61c-fa0e5de70732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.159235 Sep 06 11:56:15.360876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 379/795] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:15.479459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:15.487721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a33eb79-a66f-4f53-a541-00fd31e2e67a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.167634 Sep 06 11:56:15.488304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 417/796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:15 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:15.808488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:15.809014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:15.816146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:15.816611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:15.817045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:15.817769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:15.818228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:15.818649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:15.960122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:15.976778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3ba1e334-a790-4f80-9e69-af2414d7760a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.172203 Sep 06 11:56:15.977376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 380/797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:16.398289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:16.398916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:16.400961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:16.401886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=6 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:16.409356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:16.409884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:16.410326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:16.411064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:16.411514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:16.411960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:16.512513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:16.513705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:16.517680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=6 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:16.526220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:16.526781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:16.527272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:16.527952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:16.528461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:16.528899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:16.582468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:16.604705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:16.606250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:16.607496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-baa1607f-2743-4cb2-9752-c0d955a3aa5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.213205 Sep 06 11:56:16.608323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 418/798] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:16.697045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:16.705199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b806e302-9708-411d-96f1-0f05bd2a5f45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.196788 Sep 06 11:56:16.705813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 381/799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:16 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:17.003302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:17.003922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:17.010380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:17.010877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:17.011334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:17.012106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:17.012633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:17.013057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:17.030840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:17.171402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:17.184936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-828d2283-3b7d-4be4-a921-218e54b68bc5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.185493 Sep 06 11:56:17.187024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 419/800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:17.634571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:17.635427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:17.643039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:17.643559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:17.644073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:17.644810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:17.645416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:17.645879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:17.729262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:17.729925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:17.737296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:17.737821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:17.738253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:17.738953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:17.739403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:17.739822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:17.792263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:17.802021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:17.803910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:17.805177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8074877e-5f5f-4fea-a131-86a7e82d7cb7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1744 microversion: 2.20 time: 0.175498 Sep 06 11:56:17.805937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 382/801] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:17.884898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:17.895651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-be4ceeee-0e49-446c-9af2-3c8616ae36fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.170360 Sep 06 11:56:17.896254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 420/802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:17 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:18.213305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:18.214242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:18.220936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.221730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.222586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:18.223313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.223823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.224263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:18.346589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-2247cef5-09b4-42ae-8d43-5a1aee0a89b1 req-0ce3c824-9686-42b0-9aa5-8b22057ed20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde6a07d-6352-44f1-9e8d-84babe614815", "name": "network-vif-plugged", "status": "completed", "tag": "f9f8a407-fbad-4bfe-90d0-a44badb4b76b"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:18.361456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2247cef5-09b4-42ae-8d43-5a1aee0a89b1 req-0ce3c824-9686-42b0-9aa5-8b22057ed20d service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.362645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2247cef5-09b4-42ae-8d43-5a1aee0a89b1 req-0ce3c824-9686-42b0-9aa5-8b22057ed20d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.363521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-2247cef5-09b4-42ae-8d43-5a1aee0a89b1 req-0ce3c824-9686-42b0-9aa5-8b22057ed20d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:18.394755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-2247cef5-09b4-42ae-8d43-5a1aee0a89b1 req-0ce3c824-9686-42b0-9aa5-8b22057ed20d service nova] Creating event network-vif-plugged:f9f8a407-fbad-4bfe-90d0-a44badb4b76b for instance cde6a07d-6352-44f1-9e8d-84babe614815 on hv-cinder-85604 Sep 06 11:56:18.405188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:18.406130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-2247cef5-09b4-42ae-8d43-5a1aee0a89b1 req-0ce3c824-9686-42b0-9aa5-8b22057ed20d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064106 Sep 06 11:56:18.408351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 421/803] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:18.412207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:18.420289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-273c811b-d3f2-4875-950f-df7f37848985 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.211556 Sep 06 11:56:18.421188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 383/804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:18.837464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:18.838964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:18.848055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.848954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.849745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:18.851025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.851759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.852867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:18.923402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:18.925192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:18.943906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.949292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.950071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:18.952187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:18.952948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:18.953597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:19.098693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:19.115352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:19.118288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:19.124283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9b16e19-5ea9-44c7-b192-c942779551bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.293382 Sep 06 11:56:19.127026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 422/805] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:19.213246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:19.224836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-161eaaa4-1834-4d92-87e6-b245914d9298 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.308859 Sep 06 11:56:19.225562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 384/806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:18 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:19.445410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:19.446066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:19.453527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:19.455032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:19.455474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:19.456192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:19.456831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:19.457438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:19.625234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:19.636918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6e4ab669-6fbc-44a9-9ff4-41f6c946d85a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.192947 Sep 06 11:56:19.636918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 423/807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:20.153436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:20.154452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:20.162228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:20.163001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:20.163613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:20.164590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:20.165045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:20.165678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:20.248989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:20.250543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:20.263275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:20.265326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:20.266327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:20.268532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:20.269485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:20.270151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:20.333590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:20.344302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:20.347591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:20.349065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0becbfb0-be1f-4db8-adac-f3022376c195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.200102 Sep 06 11:56:20.365691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 385/808] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:20.520164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:20.529367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a50755b8-a171-4f1a-8951-1dcf55f121a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.284157 Sep 06 11:56:20.533280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 424/809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:20 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:20.664980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:20.666465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:20.677753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:20.678320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:20.678770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:20.679482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:20.680141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:20.680787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:20.853284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:20.863948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ddc9d999-10f1-46d5-943c-4c37a1df4de5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.205364 Sep 06 11:56:20.864788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 386/810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:21.379454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:21.380933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:21.388150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:21.388733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:21.389236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:21.390313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:21.390876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:21.391471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:21.558308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:21.562327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:21.568371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:21.580461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:21.584173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:21.584736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:21.585467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:21.587398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:21.588325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:21.588873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:21.589390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:21.590645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-91b4c475-03ea-498d-8fed-5fe11fc2c71e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.218227 Sep 06 11:56:21.596178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 425/811] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:21.797295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:21.808046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-096379f6-03ce-4ef7-8a2c-f27a05d7f51e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.252965 Sep 06 11:56:21.809674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 387/812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:21 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:21.888770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:21.889391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:21.896007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:21.896496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:21.896942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:21.897676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:21.898136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:21.898569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:22.072812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:22.085840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-53015edf-a015-4dd9-beab-930b7cf99b52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.201038 Sep 06 11:56:22.102502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 426/813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:22.633911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:22.635909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:22.649248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:22.650902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:22.651661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:22.652898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:22.654302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:22.655063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:22.836753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:22.838428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:22.840403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:22.847467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:22.849248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:22.850768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c59855f-dc4e-4ff8-8a1a-bb1986c026c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.225550 Sep 06 11:56:22.851220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:22.863952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 388/814] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:22.865010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:22.865541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:22.867207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:22.868256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:22.869495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:23.061026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:23.070453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-126fb8c4-92c9-4fb1-93df-43fdd003c626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.236552 Sep 06 11:56:23.073726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 427/815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:22 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:23.113406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:23.114194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:23.120608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:23.121242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:23.121722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:23.122485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:23.122951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:23.123382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:23.357167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:23.375165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-df37422b-ca60-4a3e-92c2-b799f70a05af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.266196 Sep 06 11:56:23.392608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 389/816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:23.878986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:23.880020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:23.892868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:23.894194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:23.894712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:23.895821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:23.896294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:23.896905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:24.095263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:24.114968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:24.115879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:24.117348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:24.119256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:24.120576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-661b0f00-bf4e-4d6e-a67e-d75314a839c3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.247264 Sep 06 11:56:24.121716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 428/817] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:24.128056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:24.128985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:24.129582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:24.130341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:24.130864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:24.131663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:24.336255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:24.349037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bfff17d9-da59-474e-8606-0bdb7ba59ffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.241438 Sep 06 11:56:24.350638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 390/818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:24 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:24.404690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:24.405218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:24.413412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:24.413943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:24.414389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:24.415117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:24.415587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:24.416025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:24.589994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:24.600998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-94ed81ee-9568-4ef0-b003-35b1cc25a602 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.200672 Sep 06 11:56:24.601926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 429/819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:25.158790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:25.159920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:25.168031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:25.168755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:25.169411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:25.170509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:25.171142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:25.171733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:25.361274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:25.372513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:25.374383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:25.374548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:25.375370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:25.376428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-af2c3b8e-427f-4597-bdf9-805681d420b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.230782 Sep 06 11:56:25.377184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 391/820] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:25.390699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:25.392162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:25.392923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:25.393903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:25.394601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:25.395250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:25.627492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:25.628462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:25.644841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:25.645683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:25.646378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:25.647314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:25.648137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:25.650588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:25.686781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:25.702539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c1164b6f-2b28-4090-8261-6da3192912b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1366 microversion: 2.1 time: 0.333954 Sep 06 11:56:25.703380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 430/821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:25 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:26.020973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:26.047946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bba73cd5-38ae-4d8e-9ca9-fffc60ff029c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.424645 Sep 06 11:56:26.049885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 392/822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:26.416677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:26.418104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:26.427073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.427590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.428227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.428947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.429520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.429942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.597192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:26.606572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:26.608050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:26.609289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc978e2b-a296-4f9c-b79c-de28f00b60f3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.196738 Sep 06 11:56:26.612634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 431/823] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:26.729900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:26.731196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:26.739388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.739930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.740381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.741102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.741560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.742024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.918649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:26.928438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-43c12568-7e77-495b-b3c0-e2d2e2ad7d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1556 microversion: 2.1 time: 0.203186 Sep 06 11:56:26.929326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 393/824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:26 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:26.959550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:26.960435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:26.966767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.967304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.967688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:26.968387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:26.968840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:26.972345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:27.074190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:27.075087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:27.086144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:27.086847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:27.087633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c8bfd43b-5db1-4df5-aa79-8a5257d2b04a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131941 Sep 06 11:56:27.088044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:27.089115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 432/825] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 11:56:26 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:27.098547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:27.099306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:27.099918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:27.419402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:27.429524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e217b46-c503-4f99-8641-57ce1f426716 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.360093 Sep 06 11:56:27.432268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 394/826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:27.637025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:27.637685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:27.659467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:27.666847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:27.668136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:27.670329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:27.671608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:27.672747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:27.957958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:27.968328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:27.971237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:27.972758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f54ae02-9715-47cb-bd5b-a0440926e80f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.341348 Sep 06 11:56:27.973780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 433/827] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:28.465761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:28.468347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:28.489219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:28.490306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:28.491517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:28.493308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:28.494227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:28.495004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:28.954940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:28.964420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae9b00a3-e66c-4560-9860-d2a44114fc97 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.507765 Sep 06 11:56:28.965271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 395/828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:29.005396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:29.006867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:29.014863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:29.015363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:29.015795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:29.017379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:29.018026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:29.018461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:29.152674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-aa48e522-6d77-4b8c-8b7e-527dbf766aa1 req-c241a9d4-f56a-4f8b-b7e2-d6aef1f95b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde6a07d-6352-44f1-9e8d-84babe614815", "tag": "f9f8a407-fbad-4bfe-90d0-a44badb4b76b"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:29.164200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-aa48e522-6d77-4b8c-8b7e-527dbf766aa1 req-c241a9d4-f56a-4f8b-b7e2-d6aef1f95b42 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:29.164689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-aa48e522-6d77-4b8c-8b7e-527dbf766aa1 req-c241a9d4-f56a-4f8b-b7e2-d6aef1f95b42 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:29.165123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-aa48e522-6d77-4b8c-8b7e-527dbf766aa1 req-c241a9d4-f56a-4f8b-b7e2-d6aef1f95b42 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:29.179542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-aa48e522-6d77-4b8c-8b7e-527dbf766aa1 req-c241a9d4-f56a-4f8b-b7e2-d6aef1f95b42 service nova] Creating event network-changed:f9f8a407-fbad-4bfe-90d0-a44badb4b76b for instance cde6a07d-6352-44f1-9e8d-84babe614815 on hv-cinder-85604 Sep 06 11:56:29.185327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-aa48e522-6d77-4b8c-8b7e-527dbf766aa1 req-c241a9d4-f56a-4f8b-b7e2-d6aef1f95b42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041729 Sep 06 11:56:29.186277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 396/829] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:56:29.208586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:29.217966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:29.219776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:29.221041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f3e1f37-9e89-4d1a-8a29-47d2158345d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.223733 Sep 06 11:56:29.221682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 434/830] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:29.991234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:29.991935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:29.998579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:29.999070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:29.999503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:30.000244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:30.000774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:30.001198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:30.174561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:30.187004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4dfa21c6-1a73-463c-b3a8-0e75d53848f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.200514 Sep 06 11:56:30.188764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 397/831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:30.249793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:30.251857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:30.260823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:30.261316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:30.262006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:30.262971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:30.263453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:30.263883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:30.447601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:30.463322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:30.466361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:30.468617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f43d1af-7382-443a-a0e9-74ba95ee46e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.224437 Sep 06 11:56:30.469979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 435/832] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:31.213383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:31.214002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:31.221848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:31.222355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:31.222796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:31.223533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:31.223996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:31.224430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:31.422481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:31.430762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8717969b-c840-4831-95d3-2a8071eec756 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.221538 Sep 06 11:56:31.431338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 398/833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:31.516656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:31.518507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:31.525350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:31.525881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:31.526314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:31.527053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:31.527500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:31.528110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:31.667288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:31.675992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:31.677477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:31.678721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-77dd6aab-cd91-432c-bdc5-cf765e25e6cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.171037 Sep 06 11:56:31.679297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 436/834] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:32.455347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:32.456045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:32.462832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.463336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.463780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.464505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.464970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.465401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.665268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:32.679114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b78e39c-11c3-4803-bec6-53a968670f5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.227813 Sep 06 11:56:32.679839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 399/835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:32.707122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:32.707739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:32.714513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.715002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.715437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.716142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:32.716593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:32.717014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:32.720681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:32.871034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:32.880143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:32.881626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:32.882845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7a4cb39-4f30-4ebc-a04a-eb6b248be242 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1739 microversion: 2.20 time: 0.180804 Sep 06 11:56:32.883412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 437/836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:33.712787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:33.713700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:33.721466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:33.721996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:33.722439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:33.723154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:33.723619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:33.724049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:33.874929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:33.884345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9f8449c5-f4b8-4fe6-ad4a-dd5ba0c80b41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.176185 Sep 06 11:56:33.884929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 400/837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:33.910739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:33.911587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:33.913701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:33.919443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:33.919933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:33.920363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:33.921058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:33.921515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:33.921963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:34.068829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:34.077942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:34.080142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:34.081419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8f55496e-325a-4de3-a0e3-5668fe2f1717 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1721 microversion: 2.20 time: 0.174608 Sep 06 11:56:34.082128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 438/838] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:34.910056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:34.910755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:34.913296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:34.920431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:34.920939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:34.921382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:34.922627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:34.923164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:34.923777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:34.929537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:35.071155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:35.081045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eda14f59-7901-4d9f-966c-0a33cdad8978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.175370 Sep 06 11:56:35.081675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 401/839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:35.108366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:35.109197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:35.116762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:35.117251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:35.117720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:35.118435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:35.118893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:35.119320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:35.272514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:35.281883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:35.283346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:35.284579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9d90e40-bc28-4000-8af5-a6dd3dce3b5d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1721 microversion: 2.20 time: 0.180244 Sep 06 11:56:35.285151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 439/840] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:36.119553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:36.120186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:36.127941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:36.128441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:36.128884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:36.129597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:36.130090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:36.130518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:36.283956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:36.296085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d3718391-5b1a-4776-908f-59d6d150f4ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.180333 Sep 06 11:56:36.297287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 402/841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:36.312441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:36.314352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:36.321401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:36.321940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:36.322383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:36.323100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:36.323564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:36.323998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:36.493752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:36.503444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:36.504895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:36.506136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-53191914-5804-4212-aeda-2ea1b0d2a7b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1721 microversion: 2.20 time: 0.197614 Sep 06 11:56:36.506713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 440/842] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:37.322010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:37.322884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:37.332868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:37.333376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:37.334214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:37.335492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:37.336321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:37.337108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:37.488505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:37.497232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a0676a3a-a118-4590-9a98-6180d37b2dd2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.181572 Sep 06 11:56:37.497868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 403/843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:37.532027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:37.532724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:37.539167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:37.539652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:37.540080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:37.540772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:37.541220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:37.541634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:37.683263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:37.692539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:37.694020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:37.695222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef07bf20-9aee-4863-9e18-38e18f1cdc10 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1721 microversion: 2.20 time: 0.167146 Sep 06 11:56:37.695795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 441/844] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:38.530807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:38.532132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:38.538932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:38.539424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:38.539873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:38.540595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:38.541052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:38.541481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:38.698407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:38.708765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aaeedcfb-ea6e-48f7-baef-07e2c73a0674 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.181764 Sep 06 11:56:38.709353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 404/845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:38.721748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:38.722365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:38.729115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:38.729610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:38.730072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:38.730783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:38.731236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:38.731656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:38.875998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:38.884697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:38.886176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:38.887343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-95cc058d-480c-47a3-bc7b-d50d3970939b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1721 microversion: 2.20 time: 0.170920 Sep 06 11:56:38.887911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 442/846] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:39.733839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:39.735719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:39.741862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:39.742350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:39.742785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:39.743475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:39.743932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:39.744351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:39.889276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:39.897824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91f582de-1272-408f-98d7-8b70c3a63d49 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1723 microversion: 2.1 time: 0.167887 Sep 06 11:56:39.898404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 405/847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:39.933611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:39.934268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:39.941072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:39.941564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:39.942064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:39.942784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:39.943246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:39.943676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:40.082685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:40.091453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:40.093059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:40.094802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-073622bc-3fcf-487d-a0f1-b427fb9c816a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1721 microversion: 2.20 time: 0.165130 Sep 06 11:56:40.095375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 443/848] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:40.302110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-7f979072-06d2-415e-abe9-011a7c60085d req-ad1bfe52-ded2-40d8-8c15-ccbf192e4f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "name": "network-vif-unplugged", "status": "completed", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:40.312648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7f979072-06d2-415e-abe9-011a7c60085d req-ad1bfe52-ded2-40d8-8c15-ccbf192e4f2a service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:40.313206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7f979072-06d2-415e-abe9-011a7c60085d req-ad1bfe52-ded2-40d8-8c15-ccbf192e4f2a service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:40.313706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7f979072-06d2-415e-abe9-011a7c60085d req-ad1bfe52-ded2-40d8-8c15-ccbf192e4f2a service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:40.325919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-7f979072-06d2-415e-abe9-011a7c60085d req-ad1bfe52-ded2-40d8-8c15-ccbf192e4f2a service nova] Creating event network-vif-unplugged:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 11:56:40.331897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-7f979072-06d2-415e-abe9-011a7c60085d req-ad1bfe52-ded2-40d8-8c15-ccbf192e4f2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035505 Sep 06 11:56:40.332488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 406/849] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:56:40.926293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:40.926919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:40.933451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:40.933931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:40.934749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:40.935446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:40.935644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:40.935966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.103424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:41.112814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a1bc74d-855c-4c21-b9a0-ef5d9cc19452 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1700 microversion: 2.1 time: 0.193751 Sep 06 11:56:41.113371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 444/850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1700 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:41.123292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:41.124059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:41.131694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.132200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.132643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.133519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.134128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.134564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.136995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab0e2a84-1ddb-49aa-94bc-ec676b02af8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:41.143932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab0e2a84-1ddb-49aa-94bc-ec676b02af8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.144310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab0e2a84-1ddb-49aa-94bc-ec676b02af8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.144743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab0e2a84-1ddb-49aa-94bc-ec676b02af8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.209439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab0e2a84-1ddb-49aa-94bc-ec676b02af8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Going to try to start instance {{(pid=127122) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 11:56:41.266479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab0e2a84-1ddb-49aa-94bc-ec676b02af8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action" status: 202 len: 0 microversion: 2.1 time: 0.133597 Sep 06 11:56:41.267685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 445/851] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:56:41 2022] POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:56:41.277483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:41.278393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:41.285796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:41.286028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.286533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.286979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.287689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.288156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.288592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.294677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:41.296155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:41.297898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f08e45a-6b97-44ef-85fa-c3c4e83ce2a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1724 microversion: 2.20 time: 0.179259 Sep 06 11:56:41.298462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 407/852] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:41.323359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "680e14de-5886-4336-b76a-757e9f7ff969"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:41.325865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:41.332022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.332564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.333034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.333845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.334328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.334806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.436147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:41.446166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dba8e594-a2e4-4c1a-ac9d-6bf9482d5570 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1709 microversion: 2.1 time: 0.173785 Sep 06 11:56:41.457672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 446/853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:41.682299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00c9915c-50d1-44b5-9d84-18c7988d46a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362797 Sep 06 11:56:41.683008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 408/854] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Sep 6 11:56:41 2022] POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:56:41.843151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:41.844310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:41.850542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.851040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.851478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.852186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.852639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.853061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.899832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127122) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 11:56:41.979513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b8fd03fc-3c6a-4068-829f-72cd99550823 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action" status: 202 len: 0 microversion: 2.20 time: 0.140386 Sep 06 11:56:41.980594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 447/855] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 6 11:56:41 2022] POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:56:41.989116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:41.989884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:41.997228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.997821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:41.998260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:41.999164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:41.999632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.000592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:42.254300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:42.274960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:42.276623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:42.277963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-06204a72-0cf8-4275-b3af-9181bf81df2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1750 microversion: 2.20 time: 0.293188 Sep 06 11:56:42.290147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 409/856] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1750 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:42.472894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:42.473452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:42.485532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:42.485872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.486503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:42.487214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:42.487665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.488086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:42.648884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:42.659158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9414623-cd64-4dc2-b6f2-fae1ad36ba5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1709 microversion: 2.1 time: 0.190717 Sep 06 11:56:42.659745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 448/857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:42.869859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:42.870321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:42.878108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:42.878606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.879046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:42.879788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:42.880198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:42.880627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.030568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lazy-loading 'services' on Instance uuid 1f4095e6-5648-4099-9d9e-bbaf5231295d {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:56:43.152786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-08510384-7264-43e2-8e81-fd47349a0b88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d/os-volume_attachments/75c0af2e-8dce-463e-a57f-37b7ea3a460e" status: 202 len: 0 microversion: 2.1 time: 0.287443 Sep 06 11:56:43.153770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 410/858] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 11:56:42 2022] DELETE /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d/os-volume_attachments/75c0af2e-8dce-463e-a57f-37b7ea3a460e => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:56:43.304033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:43.304631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:43.313277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:43.314342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:43.314786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.315503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:43.315961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:43.316386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.460949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:43.469972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:43.471401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:43.472561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cc582bfa-4c07-4922-bb4a-6060e5d9a243 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1752 microversion: 2.20 time: 0.172482 Sep 06 11:56:43.473120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 449/859] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:43.687179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:43.688345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:43.694832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:43.695313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:43.695985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.696732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:43.696898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:43.697447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:43.864893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:43.879155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b5e06e46-d7f8-4179-aa52-5cebb836b5eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1713 microversion: 2.1 time: 0.195747 Sep 06 11:56:43.880617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 411/860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1713 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:44.500662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:44.501884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:44.508378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:44.508869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:44.509305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:44.510048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:44.510537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:44.510992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:44.809351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:44.819117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:44.820556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:44.821771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a7e4dc3e-b23f-4160-968d-e113542b948d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1752 microversion: 2.20 time: 0.325706 Sep 06 11:56:44.822315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 450/861] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1752 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:45.848187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:45.848832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:45.855227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:45.855707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:45.856194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:45.856885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:45.857346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:45.857807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:45.997817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:46.007209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:46.008645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:46.009855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e47d890c-7d97-48d4-9c13-af77b49959cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.165564 Sep 06 11:56:46.010597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 412/862] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:46.419174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:46.419714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:46.426735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:46.427227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:46.427664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:46.428361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:46.428822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:46.429241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:46.455936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:56:46.458030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:46.542312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dabc6160-fef6-4a9e-81e9-0435f1bfb76a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 204 len: 0 microversion: 2.1 time: 0.126729 Sep 06 11:56:46.542906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 451/863] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 11:56:46 2022] DELETE /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:56:46.552803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:46.553417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:46.559561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:46.560055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:46.560496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:46.561200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:46.561675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:46.562149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:46.706270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:46.714170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-efaa0a27-0adc-4683-ba4e-9ee85c726925 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1513 microversion: 2.1 time: 0.165199 Sep 06 11:56:46.715031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 413/864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:46 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:47.037770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:47.038480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:47.044477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:47.044963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:47.045402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:47.046131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:47.046776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:47.047328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:47.184660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:47.193693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:47.195153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:47.196340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24631c2b-4694-4bc6-a5a8-1829b55b98cf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.163063 Sep 06 11:56:47.196902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 452/865] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:47.741034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:47.741664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:47.748266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:47.748759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:47.749192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:47.749921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:47.750446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:47.750900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:47.879799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:47.888081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f04808da-9d24-4611-a467-f0a95bb979f9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1513 microversion: 2.1 time: 0.150854 Sep 06 11:56:47.888666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 414/866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:47 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:48.223121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:48.223743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:48.230544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:48.231036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:48.231475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:48.232177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:48.232628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:48.233054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:48.373349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:48.382363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:48.383844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:48.385022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9c06efac-3c71-4b68-9693-5529a1e36adf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.166595 Sep 06 11:56:48.385598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 453/867] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:48.912964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:48.913605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:48.920399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:48.920882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:48.921323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:48.922231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:48.922698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:48.923124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:48.927453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:49.154229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:49.163774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb2a69e8-0b62-4877-82ca-a648200dc1ff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1513 microversion: 2.1 time: 0.254924 Sep 06 11:56:49.164383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 415/868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:48 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:49.412778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:49.413516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:49.423871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:49.431458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:49.432062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:49.432855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:49.433377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:49.433866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:49.704222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:49.724054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:49.725533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:49.726779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-85deba20-bafa-4ab4-bc94-08e974e51046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.318933 Sep 06 11:56:49.727338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 454/869] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:50.192301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:50.193592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:50.207503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.208263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.208863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:50.209852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.210664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.211255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:50.305870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:50.328284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bd56a733-46ae-4ace-9e41-5a16d6fa7f26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.139741 Sep 06 11:56:50.329144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 416/870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:50 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:50.382004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-97732523-1f23-4cac-b24b-0adb1c9c1373 req-f4c8a05a-ef38-42d3-a74c-166cdb04b43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4095e6-5648-4099-9d9e-bbaf5231295d", "name": "network-vif-deleted", "tag": "d2e9a927-00af-4515-98c2-3c03e430986a"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:50.393413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-97732523-1f23-4cac-b24b-0adb1c9c1373 req-f4c8a05a-ef38-42d3-a74c-166cdb04b43d service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.394104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-97732523-1f23-4cac-b24b-0adb1c9c1373 req-f4c8a05a-ef38-42d3-a74c-166cdb04b43d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.394581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-97732523-1f23-4cac-b24b-0adb1c9c1373 req-f4c8a05a-ef38-42d3-a74c-166cdb04b43d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:50.409517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-97732523-1f23-4cac-b24b-0adb1c9c1373 req-f4c8a05a-ef38-42d3-a74c-166cdb04b43d service nova] Creating event network-vif-deleted:d2e9a927-00af-4515-98c2-3c03e430986a for instance 1f4095e6-5648-4099-9d9e-bbaf5231295d on hv-cinder-85604 Sep 06 11:56:50.415755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-97732523-1f23-4cac-b24b-0adb1c9c1373 req-f4c8a05a-ef38-42d3-a74c-166cdb04b43d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098397 Sep 06 11:56:50.416770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 455/871] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:56:50.754159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:50.754773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:50.760658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.761528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.762276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:50.762970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:50.763431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:50.763860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:50.910372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:50.919791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:50.921218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:50.923242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5763675b-b093-4229-a3db-df5f76fa4d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.173596 Sep 06 11:56:50.923805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 417/872] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:51.353416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:51.354088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:51.361372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:51.361893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:51.362330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:51.363018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:51.363462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:51.363887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:51.432948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:51.444814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ef1c64b-8e76-436b-a40b-05f92fe5c8ec tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.095522 Sep 06 11:56:51.445867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 456/873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:51 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:51.949019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:51.949628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:51.957424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:51.957948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:51.958387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:51.959087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:51.959544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:51.959970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:52.104080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:52.114608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:52.116046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:52.117221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35996ebe-d5a7-4c3f-8f65-2150628197f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.172144 Sep 06 11:56:52.117807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 418/874] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:52.469781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:52.470409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:52.477320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:52.477761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:52.478204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:52.478921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:52.479381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:52.479816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:52.567111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:52.575467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b98dd0da-d669-4f1c-87ec-dceace9532fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.109607 Sep 06 11:56:52.576045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 457/875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:52 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:53.144317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:53.144916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:53.151546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:53.152025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:53.152455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:53.153137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:53.153588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:53.154027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:53.320598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:53.330691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:53.332291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:53.333552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-87b3c318-4d17-4595-9bdc-c2c35eccfd32 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.194124 Sep 06 11:56:53.334267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 419/876] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:53.599605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:53.600184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:53.606924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:53.607410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:53.607846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:53.608545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:53.609627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:53.610333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:53.679654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:53.688483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-23a24403-35b0-4134-b303-eface66d1bbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.092665 Sep 06 11:56:53.689345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 458/877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:53 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:54.359701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:54.360401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:54.367780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:54.368307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:54.368761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:54.369507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:54.370026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:54.370457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:54.543426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:54.555028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:54.556514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:54.557798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c7c75b70-4060-4b9b-817a-9bc92b2bbc24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.202191 Sep 06 11:56:54.558387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 420/878] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:54.714849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:54.715452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:54.722806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:54.723299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:54.723861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:54.724580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:54.725031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:54.725449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:54.803374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:54.812569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f4e23761-d23b-4a07-9991-c233c724cf7e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.101078 Sep 06 11:56:54.813168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 459/879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:54 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:55.585269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:55.586023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:55.592832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.594635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.595085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.595806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.596264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.596693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.764740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:55.767465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:56:55.769709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:55.776039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.776530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.776977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.777718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.778181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.778618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.779530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:55.781596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:55.782917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9018496c-c230-4c23-af48-ec6ec7323a1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.201693 Sep 06 11:56:55.783713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 421/880] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:55.837129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:55.837816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:55.844960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.845458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.846027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.846751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.847216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.847652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.867627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c17d7b02-b43a-4e84-8443-6e8c0dc4c73d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.104724 Sep 06 11:56:55.868589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 460/881] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:56:55 2022] POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 11:56:55.878564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:55.879267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:55.885823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.886316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.886744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.887447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:55.887896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:55.888316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:55.921006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:55.941117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8ff0632d-af70-49b1-b21a-4b8e2489c61e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.106735 Sep 06 11:56:55.949882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 422/882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:55 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:56.090630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:56.100411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66f49b35-7b55-430f-9725-c6ff78f2c74e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.226092 Sep 06 11:56:56.101013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 461/883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:56.810853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:56.813362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:56.821674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:56.822145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:56.823041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:56.823677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:56.824108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:56.824774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:56.964697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:56.966466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:56.967112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:56.973963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:56.974456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:56.974561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:56.974900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:56.975638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:56.975907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:56.976100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:56.976556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:56.977074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-240d2e40-fe95-4a10-b718-2d9ad1f49767 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.170791 Sep 06 11:56:56.977873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 423/884] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:57.041058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:57.050171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-31137b07-f555-48e7-8aed-9b6c2ed3f13c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.087626 Sep 06 11:56:57.050851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 462/885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:56 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:57.125384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:57.125926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:57.131994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:57.132473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:57.132907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:57.133602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:57.134087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:57.134512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:57.301590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:57.318138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1d5f1677-55d0-4927-a38e-6a83744a6952 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.196487 Sep 06 11:56:57.319137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 424/886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:58.005175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:58.006529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:58.013224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.013752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.014199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.015759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.016224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.016815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.081314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:58.082552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:58.089235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.089765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.090210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.090912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.091370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.091802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.170543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:58.173833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:58.179957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac983d8f-e0ec-453c-9713-5428e3bcbd73 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.103362 Sep 06 11:56:58.180459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 425/887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:58 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:56:58.183550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:58.185077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:58.186622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0b9a236b-efe7-4f11-afb7-f1ee55128fcb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.187239 Sep 06 11:56:58.187960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 463/888] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:56:58.344745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:58.345274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:58.351324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.351805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.352238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.352934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:58.353389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:58.353846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:58.511566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:58.521112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-257eb2c3-9fa0-4675-a8cf-337c9aa384f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.180593 Sep 06 11:56:58.521722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 426/889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:59.207477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:59.208246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:59.214547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.215047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.215490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.216207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.216673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.216844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:59.217412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.217792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:59.225248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.225984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.226493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.227458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.227995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.228498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.307413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:59.316007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f0097e0a-a0fd-4cd1-b229-f29c16bdd848 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.113758 Sep 06 11:56:59.316739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 464/890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:59 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:56:59.400431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:59.414492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:59.417717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:59.419805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7dcc4489-86bd-4d42-81f6-fa7b0c95782b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.207093 Sep 06 11:56:59.421374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 427/891] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:56:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:56:59.545105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:56:59.545756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:56:59.552017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.552506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.552945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.553674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:56:59.554130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:56:59.554558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:56:59.717063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:56:59.725538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4cdb0036-be09-4158-b998-0a23048b4d12 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.184927 Sep 06 11:56:59.726157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 465/892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:56:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:00.341700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:00.351806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:00.353938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.354447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.354883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.355581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.356060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.356477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.423919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:00.431658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c7fc5e0b-f420-4574-aa68-519f833f3785 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.093979 Sep 06 11:57:00.432232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 428/893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:00 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:00.446833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:00.447449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:00.453974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.454466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.454929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.455625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.456090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.456523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.471968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:00.594539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:00.603243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:00.604688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:00.605884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9febbe35-728f-4b2d-bb3b-3a5ef36ac842 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.163074 Sep 06 11:57:00.606450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 466/894] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:00.751167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:00.751839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:00.757945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.758435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.758868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.759558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:00.760016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:00.760443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:00.912915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:00.922489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f5f29320-a9b3-4f93-bae3-8b26f36eb19c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.175639 Sep 06 11:57:00.922890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 429/895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:01.455056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:01.455719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:01.462287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.462777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.463217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:01.463916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.464378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.464806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:01.534426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:01.542732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-abc5be11-7122-403e-9ab7-503cef55347a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.091985 Sep 06 11:57:01.543309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 467/896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:01 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:01.632466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:01.633096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:01.640864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.641442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.641911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:01.642625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.643088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.643534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:01.781789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:01.790218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:01.791669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:01.792844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d3904c0e-124e-43e8-af60-380bf8861b4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.164366 Sep 06 11:57:01.793403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 430/897] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:01.945923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:01.946547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:01.953178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.953717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.954166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:01.954866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:01.955328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:01.955758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:02.121616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:02.131123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9cf5d30e-54b6-41cf-90de-d567b6c99f19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.188989 Sep 06 11:57:02.131710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 468/898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:02.568280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:02.569192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:02.576033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:02.576855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:02.577496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:02.578431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:02.578893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:02.579359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:02.660930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:02.664321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:02.669497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8f5c1a0b-fd9b-4a07-b859-509403b5a6a5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.105205 Sep 06 11:57:02.670083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 431/899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:02 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:02.818569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:02.819206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:02.825982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:02.826461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:02.826890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:02.828132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:02.828614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:02.829010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.002207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:03.011478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:03.012906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:03.014184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1008633-57e9-4d4d-8cc1-162cb87e0903 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.199750 Sep 06 11:57:03.016161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 469/900] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:03.155651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:03.156435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:03.162493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:03.162988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:03.163425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.164129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:03.164589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:03.165017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.330980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:03.339593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c770859f-74a1-423a-837b-cfb1f1bc9c5e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.188178 Sep 06 11:57:03.340595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 432/901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:03.695036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:03.696005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:03.705548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:03.706555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:03.707230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.708166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:03.708841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:03.709482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:03.777738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:03.785455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b5a6b31a-9004-44b7-97d2-f22d62e33391 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.094548 Sep 06 11:57:03.786052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 470/902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:03 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:04.042230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:04.042851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:04.050225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.050663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.051098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.051789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.052283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.052663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.189457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:04.198076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:04.199513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:04.200669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e364bad0-9010-465d-943e-b6624b1ef86e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.162467 Sep 06 11:57:04.201228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 433/903] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:04.365679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:04.366273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:04.368547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:04.375587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.376145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.376589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.377721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.378211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.378645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.530121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:04.539125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c55c9e3f-6e17-4421-855f-5fe2172786e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.178002 Sep 06 11:57:04.539708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 471/904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:04.808850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:04.809863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:04.816491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.816982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.817419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:04.818144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:04.818603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:04.819035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.091623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:05.100634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74017907-cbc3-4de5-a123-d8fb7be9d28b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.295790 Sep 06 11:57:05.101302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 434/905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:04 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:05.228501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:05.229147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:05.235693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.236173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.236610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.237300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.237785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.238220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.369499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:05.379144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:05.380591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:05.381780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d4f6abce-09a3-464b-b4a6-d7dec8e00b21 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.157227 Sep 06 11:57:05.382348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 472/906] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:05.563258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:05.563863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:05.565682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=68 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:05.571123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.571533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.571962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.572650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:05.573099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:05.573520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:05.729848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:05.738754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ccab54cc-f255-455e-acf3-4fe91db2ff36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.179889 Sep 06 11:57:05.739326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 435/907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:06.124801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:06.125404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:06.131433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.131921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.132361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.133054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.133509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.133964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.198756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:06.207309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c04d3378-9020-477c-936c-61fc1fab5cbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1471 microversion: 2.1 time: 0.086826 Sep 06 11:57:06.207890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 473/908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:06 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:06.407595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:06.408169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:06.414476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.414953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.415383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.416060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.416506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.416928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.550635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:06.559082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:06.560509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:06.562386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5affaff0-8e93-4833-889a-af5db7bd9cf3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.158411 Sep 06 11:57:06.562943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 436/909] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:06.761951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:06.762561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:06.769318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.769848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.770293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.770995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:06.771455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:06.771879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:06.918937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:06.928030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4765518e-3d83-454d-8e27-b4eb8f1146a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.170070 Sep 06 11:57:06.928599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 474/910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:07.230720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:07.231483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:07.238620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.239106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.239570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.240265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.240712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.241131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.304646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:07.312619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c3fb33ed-c472-4b95-ab56-1eb347250200 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1304 microversion: 2.1 time: 0.085779 Sep 06 11:57:07.313116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 437/911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:07 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:07.587682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:07.588206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:07.595065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.595549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.595986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.596682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.597140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.597566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.728978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:07.737782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:07.739234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:07.740402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8ce93813-cedb-48cd-b9c0-55bca6defe27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.156747 Sep 06 11:57:07.741018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 475/912] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:07.953686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:07.954314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:07.960755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.961235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.961687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:07.962385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:07.962835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:07.963254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:08.109002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:08.117500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b85f696-8273-49ae-b771-5ecf383a4824 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.168574 Sep 06 11:57:08.118120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 438/913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:08.336220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:08.336994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:08.344093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:08.344579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:08.345040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:08.345855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:08.346306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:08.346737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:08.412368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:08.420467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e67af67-a90b-47b2-9b8c-fccafbfc4cc6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1304 microversion: 2.1 time: 0.088125 Sep 06 11:57:08.421633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 476/914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:08 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:08.768455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:08.769107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:08.775894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:08.776389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:08.776828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:08.777541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:08.778222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:08.778459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:08.946585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:08.956295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:08.957906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:08.959111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92da1fdb-7c6d-49e2-b9de-39e230f69f50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.197296 Sep 06 11:57:08.959688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 439/915] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:09.143211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:09.143773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:09.150035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.150716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.151093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.151793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.152249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.152665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.419912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:09.432477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4488fa99-cb3c-47b1-af22-d7b15be13c77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1751 microversion: 2.1 time: 0.294633 Sep 06 11:57:09.433347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 477/916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1751 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:09.446450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:09.447773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:09.455075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.456094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.456995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.457804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.458339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.459021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.494212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.494692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.495120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.495564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lazy-loading 'fault' on Instance uuid 1f4095e6-5648-4099-9d9e-bbaf5231295d {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:57:09.538187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:09.546945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7ef89550-d5f6-4031-90d9-25a108cf458c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 200 len: 1309 microversion: 2.1 time: 0.105080 Sep 06 11:57:09.547600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 440/917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:09 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:09.986613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:09.987223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:09.993182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.993680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.994112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:09.994822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:09.995329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:09.995694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.143654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:10.152323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:10.153778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:10.154938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4d270379-f784-41c9-9712-051bb9d9c241 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.173074 Sep 06 11:57:10.156126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 478/918] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:10.457785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:10.458409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:10.465091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.465589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.466069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.466775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.467225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.468375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.571190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:10.571788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 1f4095e6-5648-4099-9d9e-bbaf5231295d] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:10.574250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:57:10.574417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 11:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d (ip 10.222.0.18) !!! Sep 06 11:57:10.581620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.582125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.582556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.583256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:10.583705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:10.584124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:10.599083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] HTTP exception thrown: Instance 1f4095e6-5648-4099-9d9e-bbaf5231295d could not be found. Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Request method failure captured: Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d HTTP/1.1 Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzURA7DWgsLzBnKq8Mo4lEBjMk_T7rSsmOt8si2h7DGrifHyjv3gn58UHj7fS-mPGDeHYLTVM0TB3_LsPifRE_rQvrirkDuovZgsKAbZ_6UkfVVWz5ULRChkvRpLiQerNyQW9s98in3phphoTcvDTb9fckfLhVerYAWvDILUrvFCgCs Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 223f7e0f4ea74b398aad606cf1e7c150 Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1720789506 Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:57:10.600762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/223f7e0f4ea74b398aad606cf1e7c150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/223f7e0f4ea74b398aad606cf1e7c150"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_223f7e0f4ea74b398aad606cf1e7c150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/223f7e0f4ea74b398aad606cf1e7c150"}]}] Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesSnapshotTestJSON-1720789506 Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 223f7e0f4ea74b398aad606cf1e7c150 Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1720789506 Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesSnapshotTestJSON-1720789506-project Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 317022dc9f1d46cbbe7190edd7832e43 Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesSnapshotTestJSON-1720789506-project Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 1f4095e6-5648-4099-9d9e-bbaf5231295d could not be found. Sep 06 11:57:10.602407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '1f4095e6-5648-4099-9d9e-bbaf5231295d'} Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4095e6-5648-4099-9d9e-bbaf5231295d could not be found. Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:57:10.603539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4095e6-5648-4099-9d9e-bbaf5231295d could not be found. Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4095e6-5648-4099-9d9e-bbaf5231295d could not be found. Sep 06 11:57:10.604863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:57:10.606038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Returning 404 to user: Instance 1f4095e6-5648-4099-9d9e-bbaf5231295d could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:57:10.606038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c37c49ad-c600-49e3-a212-c08286f89cae tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d" status: 404 len: 111 microversion: 2.1 time: 0.034813 Sep 06 11:57:10.606038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 479/919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:10 2022] GET /compute/v2.1/servers/1f4095e6-5648-4099-9d9e-bbaf5231295d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 11:57:10.628613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:10.637438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8e68382a-7c6a-4cb3-9c86-55ee644464af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.183507 Sep 06 11:57:10.638199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 441/920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:11.181506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:11.182152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:11.188838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:11.189326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:11.189801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:11.190504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:11.190963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:11.191392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:11.321433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:11.331013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:11.332482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:11.333651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-837bef10-510c-4cbe-9857-2d3a0f409404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.156097 Sep 06 11:57:11.334212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 480/921] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:11.663293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:11.663903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:11.670269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:11.671347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:11.671783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:11.672460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:11.672904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:11.673320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:11.819299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:11.828354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00d4e8a3-e3fa-4b7b-8367-457be74deaff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.168872 Sep 06 11:57:11.828936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 442/922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:12.359346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:12.359956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:12.368288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.369106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.369597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:12.370336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.370799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.371230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:12.508386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:12.518181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:12.519637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:12.520806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-646f31be-c7e1-4a7d-b428-6c401d943613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.165461 Sep 06 11:57:12.521357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 481/923] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:12.853687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:12.854293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:12.862469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.862971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.863414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:12.864121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:12.864581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:12.865009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:13.012657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:13.021479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3648d4ac-6a24-453e-8cae-6c8351a6f335 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.172282 Sep 06 11:57:13.022213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 443/924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:13.546136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:13.546829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:13.553372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:13.553913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:13.554354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:13.555095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:13.555558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:13.555992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:13.694037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:13.703098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:13.704526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:13.705740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-183c63dd-b5ac-4fd8-84ab-59477b882434 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.163555 Sep 06 11:57:13.706304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 482/925] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:14.044427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:14.045048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:14.053295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:14.053822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:14.054256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:14.054955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:14.055402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:14.055821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:14.205285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:14.213716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c602e1f9-58c4-43dc-a1d2-e7097bfc5175 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.173104 Sep 06 11:57:14.214303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 444/926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:14.731389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:14.732034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:14.739480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:14.739964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:14.740399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:14.741107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:14.741560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:14.742016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:14.890650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:14.892881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:14.900921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:14.902406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:14.903684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d043a242-9736-44b2-a208-393f74c7b196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.176239 Sep 06 11:57:14.904257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 483/927] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:15.238527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:15.239155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:15.245880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:15.246378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:15.246819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:15.247540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:15.247999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:15.248432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:15.428266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:15.437619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4c5e9f0a-97c1-438b-8283-d5094fbd6f26 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.203055 Sep 06 11:57:15.438376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 445/928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:15.930260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:15.930854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:15.938324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:15.938814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:15.939247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:15.939954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:15.940410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:15.940915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:16.076400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:16.086148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:16.087620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:16.096113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ceaa441f-f28e-47ce-925f-96e6b126cbed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.162657 Sep 06 11:57:16.096113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 484/929] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:16.461317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:16.461930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:16.468751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:16.469386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:16.469961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:16.470995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:16.471568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:16.472134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:16.619333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:16.628122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3abbc089-b3e8-43dc-b0fe-09d6418e8d9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.170784 Sep 06 11:57:16.628722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 446/930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:17.116475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:17.117097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:17.124297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:17.124982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:17.125428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:17.126300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:17.126766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:17.127193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:17.270166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:17.278855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:17.280480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:17.281681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-79d2f9c4-c006-4502-bb4b-4b1e511cba97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.169177 Sep 06 11:57:17.282250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 485/931] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:17.711272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:17.711923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:17.718388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:17.718962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:17.719401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:17.720096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:17.720553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:17.720985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:17.866169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:17.874452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-027f6be0-652a-442d-ac3d-f83b10a125f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.166943 Sep 06 11:57:17.875144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 447/932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:18.307520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:18.308168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:18.314829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.315318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.315755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.316451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.316913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.317342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.462358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:18.471641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:18.473076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:18.474283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bcedfd6d-1808-43a4-8b6d-4a4386f0817e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.170696 Sep 06 11:57:18.474848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 486/933] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:18.897943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:18.898583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:18.905192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.905707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.906152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.906844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:18.907303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:18.907731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:18.911844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:19.054047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:19.062414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5293e743-b7ba-4a3c-9d96-438eb0436fcc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.168318 Sep 06 11:57:19.062988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 448/934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:19.502779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:19.503323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:19.510035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.510531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.510972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.511680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:19.512142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:19.512573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:19.649164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:19.657901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:19.659363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:19.660533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0c528120-ee00-4a07-b4ff-88707f219e37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.162514 Sep 06 11:57:19.661110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 487/935] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:20.089872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:20.091011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:20.098418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:20.099117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:20.099352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:20.100058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:20.100515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:20.100943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:20.262956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:20.273184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3027d030-5a77-4b94-9aa3-5b6a25107ba5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.190617 Sep 06 11:57:20.273796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 449/936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:20.686544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:20.687135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:20.694120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:20.694609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:20.695093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:20.695747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:20.696209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:20.696637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:20.835972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:20.845119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:20.846755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:20.847931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-02841195-4417-468d-9676-ee92cc96f615 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.165355 Sep 06 11:57:20.848650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 488/937] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:21.304285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:21.304903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:21.311371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:21.311846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:21.312276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:21.313853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:21.314308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:21.314729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:21.466979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:21.476657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d85f1ecb-0822-4645-ba43-cc8008830555 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.175794 Sep 06 11:57:21.476808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 450/938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:21.875349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:21.875983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:21.885384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:21.886243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:21.887058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:21.888042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:21.888714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:21.889749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:22.027432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:22.036675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:22.038148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:22.039294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-05ee62e8-60e9-4dd7-8739-492a561ac984 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.167929 Sep 06 11:57:22.039858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 489/939] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:22.501227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:22.501900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:22.508558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:22.509048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:22.509484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:22.510222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:22.510681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:22.513350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:22.646588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1172010373", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "networks": [{"uuid": "20d96228-f9ba-4111-a17c-85b905e1e49f"}]}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:22.676766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:22.685017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-61147542-f82e-460d-aa43-a64d93ab24c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.188364 Sep 06 11:57:22.685587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 451/940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:22.707240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] validate_networks() for [('20d96228-f9ba-4111-a17c-85b905e1e49f', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 11:57:23.065217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:23.065872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:23.071912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.072416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.072854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.073619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.074054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.074489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.075997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 11:57:23.076481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 11:57:23.076927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 11:57:23.077334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 11:57:23.077795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 11:57:23.088956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.089562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.090176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.090943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.091469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.091866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.111461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Getting quotas for project 223f7e0f4ea74b398aad606cf1e7c150. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 11:57:23.115740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Getting quotas for user 317022dc9f1d46cbbe7190edd7832e43 and project 223f7e0f4ea74b398aad606cf1e7c150. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 11:57:23.128728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 11:57:23.131174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 11:57:23.183286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e392fdd-32ac-4e3f-8d3d-aee37ed6344f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542511 Sep 06 11:57:23.184104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 490/941] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 11:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 11:57:23.195427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a6060d8f-890c-4a96-8c27-be9a9eaa1d5a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:23.196097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a6060d8f-890c-4a96-8c27-be9a9eaa1d5a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:23.224417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:23.240104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:23.242070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:23.243816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-51f3fab1-889a-4e54-bfb6-6529336f237d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.183494 Sep 06 11:57:23.244683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 452/942] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:23.262284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a6060d8f-890c-4a96-8c27-be9a9eaa1d5a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:23.273769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a6060d8f-890c-4a96-8c27-be9a9eaa1d5a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1219 microversion: 2.1 time: 0.082320 Sep 06 11:57:23.274350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 491/943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:23 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:23.710909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:23.711767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:23.718298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.719861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.720222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.720929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:23.721391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:23.721876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:23.880046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:23.891741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52c9ea3a-b672-42d3-8cfb-da640e228d0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.185477 Sep 06 11:57:23.892402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 453/944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:24.042092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-aacff14d-3a1b-4540-b6f3-6e6e7a2f2db3 req-9f7cf87f-e3c2-4297-a2b1-5099c7b22348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "name": "network-vif-plugged", "status": "completed", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:24.054578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-aacff14d-3a1b-4540-b6f3-6e6e7a2f2db3 req-9f7cf87f-e3c2-4297-a2b1-5099c7b22348 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.055302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-aacff14d-3a1b-4540-b6f3-6e6e7a2f2db3 req-9f7cf87f-e3c2-4297-a2b1-5099c7b22348 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.055900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-aacff14d-3a1b-4540-b6f3-6e6e7a2f2db3 req-9f7cf87f-e3c2-4297-a2b1-5099c7b22348 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.069146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-aacff14d-3a1b-4540-b6f3-6e6e7a2f2db3 req-9f7cf87f-e3c2-4297-a2b1-5099c7b22348 service nova] Creating event network-vif-plugged:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 11:57:24.076495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-aacff14d-3a1b-4540-b6f3-6e6e7a2f2db3 req-9f7cf87f-e3c2-4297-a2b1-5099c7b22348 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038220 Sep 06 11:57:24.077363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 492/945] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:57:24.271914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:24.272531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:24.278557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.279044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.279483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.280173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.280627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.281129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.297597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:24.298339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:24.304913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.305401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.305870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.306574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.307030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.307456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.371524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:24.379886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d3be9e32-33f3-4d67-86f1-e284a269d64c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1271 microversion: 2.1 time: 0.086560 Sep 06 11:57:24.380508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 493/946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:24.416919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:24.425466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:24.426932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:24.428086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9345a98d-d104-4c47-88d2-75c638506630 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.160258 Sep 06 11:57:24.428640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 454/947] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:24.925622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:24.926386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:24.932309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.932787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.933218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:24.933925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:24.934380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:24.934803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:25.096477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:25.105978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a68bd1e4-eda1-4c68-b822-b2f9959fb82e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.184891 Sep 06 11:57:25.107138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 494/948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:25.404386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:25.405308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:25.413038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:25.413720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:25.414333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:25.415162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:25.415617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:25.416043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:25.455144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:25.455876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:25.462538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:25.463057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:25.463494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:25.464226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:25.464684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:25.465131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:25.485934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:25.493583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b3e29288-93e0-460c-bd06-f46af4c35a28 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1289 microversion: 2.1 time: 0.093092 Sep 06 11:57:25.494194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 455/949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:25 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:25.607693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:25.616485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:25.617970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:25.619147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eaeb4961-3272-4a12-8782-57bbcafbb251 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.168672 Sep 06 11:57:25.619716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 495/950] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:26.132332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:26.132858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:26.138898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:26.139642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:26.140079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:26.141062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:26.141241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:26.141667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:26.383287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:26.394918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69065b9d-8607-441d-a6e4-2cf2dfba7b95 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.266477 Sep 06 11:57:26.395500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 456/951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:57:26.517367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:26.518098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:26.524544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:26.525040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:26.525483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:26.526212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:26.526670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:26.527099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:26.644938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:26.645499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:26.651804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:26.652288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:26.652726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:26.653425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:26.653906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:26.654337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:26.662097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:26.670129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-431a78be-5582-4c78-9c1a-b584895f90df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.157035 Sep 06 11:57:26.670944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 496/952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:26 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:26.786075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:26.794509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:26.795949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:26.797608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b50d394f-6a6e-4e17-b4ba-93137a3d516b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.156597 Sep 06 11:57:26.798416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 457/953] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:27.419833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:27.420540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:27.427432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.427998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.428507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.429292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.429862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.430364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.580468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:27.589768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fbeea96c-1953-4812-8145-0f65eab50b9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1756 microversion: 2.1 time: 0.173755 Sep 06 11:57:27.590555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 497/954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:27.618735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-97f1f526-77ac-41ce-aeff-afd7c248aefa req-38c4b742-0244-499e-a1de-a848d97e6e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7", "tag": "e0ed188e-7299-4f7d-ac8d-235a45b2fab6"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:27.628806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-97f1f526-77ac-41ce-aeff-afd7c248aefa req-38c4b742-0244-499e-a1de-a848d97e6e78 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.629297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-97f1f526-77ac-41ce-aeff-afd7c248aefa req-38c4b742-0244-499e-a1de-a848d97e6e78 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.629761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-97f1f526-77ac-41ce-aeff-afd7c248aefa req-38c4b742-0244-499e-a1de-a848d97e6e78 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.647911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-97f1f526-77ac-41ce-aeff-afd7c248aefa req-38c4b742-0244-499e-a1de-a848d97e6e78 service nova] Creating event network-changed:e0ed188e-7299-4f7d-ac8d-235a45b2fab6 for instance 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 on hv-cinder-85604 Sep 06 11:57:27.653031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-97f1f526-77ac-41ce-aeff-afd7c248aefa req-38c4b742-0244-499e-a1de-a848d97e6e78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037980 Sep 06 11:57:27.653628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 458/955] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:57:27.693444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:27.694376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:27.700860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.701351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.701839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.702544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.703749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.704183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.829879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:27.830730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:27.838030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.838832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.839366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.840175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:27.841021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:27.841521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:27.844190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:27.858068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f7036323-d935-41da-9dc8-718038b3e6e2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.168737 Sep 06 11:57:27.858599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 498/956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:27 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:28.008916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:28.018881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:28.020316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:28.021477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0cce80ee-0ca3-4589-af3a-78778009f63b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1808 microversion: 2.20 time: 0.198467 Sep 06 11:57:28.022053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 459/957] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 11:57:28.614755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:28.615450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:28.621522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:28.622039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:28.622483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:28.623177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:28.623641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:28.624071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:28.778717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:28.787788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-31c1e8d4-9545-468f-92fa-450c1801b1db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1759 microversion: 2.1 time: 0.177938 Sep 06 11:57:28.788374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 499/958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:28.881239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:28.881801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:28.888303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:28.888791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:28.889478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:28.890830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:28.891441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:28.891955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.031722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:29.039751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bbdd7526-82a5-42b0-94c2-ed310b88e18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.162657 Sep 06 11:57:29.040329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 460/959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:29.048961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:29.049612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:29.058978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.059468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.060210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.060961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:29.061500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:29.062823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:29.201373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:29.210427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:29.211880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:29.213055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8dba951f-e7c7-42ff-974d-dafd623dee82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1795 microversion: 2.20 time: 0.168741 Sep 06 11:57:29.213624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 500/960] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 11:57:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1795 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 11:57:30.062999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:30.063629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:30.069927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:30.070402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:30.070862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:30.071550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:30.072001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:30.072416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:30.203529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:30.211704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c407e9a4-3fcb-41a5-b6d6-f10779cf149f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.152719 Sep 06 11:57:30.212456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 461/961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:31.235496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:31.236169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:31.243120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:31.243664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:31.244160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:31.244934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:31.245449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:31.245991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:31.381444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:31.389211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-921c3414-b4aa-4896-a73d-eac0f5306445 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.157709 Sep 06 11:57:31.390128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 501/962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:31 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:32.413560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:32.414273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:32.420694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:32.421182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:32.421712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:32.422437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:32.422894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:32.423326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:32.559553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:32.568343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8a3c5d98-b764-4e40-b5c0-3c52400b77dc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.159288 Sep 06 11:57:32.568915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 462/963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:32 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:33.591729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:33.592368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:33.594803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:33.595472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=8 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:33.601658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:33.602144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:33.602575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:33.603264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:33.603714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:33.604132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:33.742836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:33.745006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:33.752477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe3592f0-7d9f-4885-954d-9877cc2807e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.164612 Sep 06 11:57:33.753052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 502/964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:33 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:34.776194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:34.776864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:34.783889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:34.784375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:34.784805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:34.786062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:34.786525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:34.786956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:34.924342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:34.932618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-58bae4dd-73f1-47a4-bfc9-8ab651538c89 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.160828 Sep 06 11:57:34.933203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 463/965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:35.955808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:35.956425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:35.958845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:35.964218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:35.964709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:35.965148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:35.965877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:35.966336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:35.966762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:36.098437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:36.106746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0111f2d-3bbd-4c32-a85f-2bb389df173b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.154820 Sep 06 11:57:36.107313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 503/966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:35 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:36.650429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-6322d02d-c951-4e35-a061-13bcb1a965d7 req-6bf3cf85-6fc1-4622-855b-c595a5e7cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7", "name": "network-vif-plugged", "status": "completed", "tag": "e0ed188e-7299-4f7d-ac8d-235a45b2fab6"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:36.656583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=60 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:36.662720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6322d02d-c951-4e35-a061-13bcb1a965d7 req-6bf3cf85-6fc1-4622-855b-c595a5e7cbb4 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:36.663240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6322d02d-c951-4e35-a061-13bcb1a965d7 req-6bf3cf85-6fc1-4622-855b-c595a5e7cbb4 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:36.663671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6322d02d-c951-4e35-a061-13bcb1a965d7 req-6bf3cf85-6fc1-4622-855b-c595a5e7cbb4 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:36.675004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-6322d02d-c951-4e35-a061-13bcb1a965d7 req-6bf3cf85-6fc1-4622-855b-c595a5e7cbb4 service nova] Creating event network-vif-plugged:e0ed188e-7299-4f7d-ac8d-235a45b2fab6 for instance 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 on hv-cinder-85604 Sep 06 11:57:36.679963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-6322d02d-c951-4e35-a061-13bcb1a965d7 req-6bf3cf85-6fc1-4622-855b-c595a5e7cbb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034879 Sep 06 11:57:36.680549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 464/967] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:57:37.130967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:37.131987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:37.138634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:37.139472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:37.139969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:37.140701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:37.141163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:37.141601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:37.280863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:37.289939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a222bec-9786-42a7-bd0a-729226e16870 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.163611 Sep 06 11:57:37.290636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 504/968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:37 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:38.316115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:38.316865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:38.324595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:38.325078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:38.325532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:38.326256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:38.326727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:38.327158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:38.462988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:38.470643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35cdb0cc-8b75-4fd7-bcf3-0ad0a9d2ca22 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.159874 Sep 06 11:57:38.471214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 465/969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:39.494116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:39.494742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:39.501852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:39.502338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:39.502775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:39.503473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:39.503928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:39.504353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:39.638819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:39.647646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41fe7b46-03f4-4ad3-808e-1ee3016274f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1319 microversion: 2.1 time: 0.157581 Sep 06 11:57:39.648147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 505/970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:39 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:40.672744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:57:40.673372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:40.680279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:40.680752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:40.681183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:40.681897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:40.682342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:40.682768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:40.686739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:40.813231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:57:40.821138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37aa4a28-5522-476a-89af-09c8493902e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1507 microversion: 2.1 time: 0.152400 Sep 06 11:57:40.821733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 466/971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:57:40 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:57:40.845210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "606f4edf-b2eb-4dff-96cb-3c402e789d26", "device": "/dev/sdb"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:40.847791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:40.854559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:40.855052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:40.855493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:40.856196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:40.856658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:40.857089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:41.315547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5100a80e-d334-4324-8101-9d67439a83a6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "POST /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475108 Sep 06 11:57:41.316779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 506/972] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:57:40 2022] POST /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:57:51.715485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=5 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:51.716226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:51.824654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fd8d628-e705-477b-b3fa-399ef5fe20ec"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:57:51.827117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:57:51.833120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:51.833534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:51.833997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:51.834676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:57:51.835127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:57:51.835545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:57:54.943725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2470b5d-96dd-42c8-b611-d63aface96ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.233886 Sep 06 11:57:54.944574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 467/973] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:57:51 2022] POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 194 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:40.920322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=7 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:40.921549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:40.926879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:40.927475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:40.936283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:40.936771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:40.937213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:40.937952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:40.938417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:40.938844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:41.066799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lazy-loading 'services' on Instance uuid 2942181c-63de-4194-946d-9d8ca5c4b4a3 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:58:41.180064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d39a044f-4803-4243-a80b-32dbab841dca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments/c96da1c3-436a-4ff1-902a-4bcaf06e7add" status: 202 len: 0 microversion: 2.1 time: 0.261516 Sep 06 11:58:41.180624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 507/974] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 11:58:40 2022] DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments/c96da1c3-436a-4ff1-902a-4bcaf06e7add => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:58:43.525448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:43.526102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:43.528366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:43.529045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:43.530331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 11:58:43.530513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 11:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/ips (ip 10.222.0.18) !!! Sep 06 11:58:43.539449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.539947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.540384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.541088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.541549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.542009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.568077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a5c9c81c-0b8b-4de5-a76a-5491bf2455ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/ips" status: 200 len: 150 microversion: 2.1 time: 0.046852 Sep 06 11:58:43.568676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 468/975] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 11:58:43 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:58:43.581498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a016920c-b2b3-4b24-9fda-8978dc638daf"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:58:43.583940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:43.594105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.594105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.594499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.595239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.595695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.596122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.680722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Invalid volume: volume a016920c-b2b3-4b24-9fda-8978dc638daf is already attached to instances: 23cb205f-f79a-4c52-b0e3-190868135839 Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: POST /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/os-volume_attachments HTTP/1.1 Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 74 Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:58:43.683206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {"volumeAttachment": {"volumeId": "a016920c-b2b3-4b24-9fda-8978dc638daf"}} Sep 06 11:58:43.684903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Invalid volume: volume a016920c-b2b3-4b24-9fda-8978dc638daf is already attached to instances: 23cb205f-f79a-4c52-b0e3-190868135839 Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'server_id': 'cde6a07d-6352-44f1-9e8d-84babe614815', 'body': {'volumeAttachment': {'volumeId': 'a016920c-b2b3-4b24-9fda-8978dc638daf'}}} Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a016920c-b2b3-4b24-9fda-8978dc638daf is already attached to instances: 23cb205f-f79a-4c52-b0e3-190868135839 Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:58:43.685859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a016920c-b2b3-4b24-9fda-8978dc638daf is already attached to instances: 23cb205f-f79a-4c52-b0e3-190868135839 Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:58:43.687350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a016920c-b2b3-4b24-9fda-8978dc638daf is already attached to instances: 23cb205f-f79a-4c52-b0e3-190868135839 Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 400 to user: Invalid volume: volume a016920c-b2b3-4b24-9fda-8978dc638daf is already attached to instances: 23cb205f-f79a-4c52-b0e3-190868135839 {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-18810a6d-ecae-492c-af07-4ba53393686f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108181 Sep 06 11:58:43.688846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 508/976] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 11:58:43 2022] POST /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 11:58:43.693801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:43.694302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:43.700860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.701555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.702152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.703109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.703570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.704000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.730507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 11:58:43.807815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eaa58cf5-b539-4dbb-954e-f86bda6220d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 204 len: 0 microversion: 2.1 time: 0.117416 Sep 06 11:58:43.808263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 469/977] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 11:58:43 2022] DELETE /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 11:58:43.816700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:43.817312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:43.824343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.824830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.825271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.826009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:43.826472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:43.826932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:43.980404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:43.988265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cc9df92c-27ad-4b63-8a80-d0a5b73ea5a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.175456 Sep 06 11:58:43.988836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 509/978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:43 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:45.012929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:45.013706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:45.021118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:45.021612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:45.022888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:45.023959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:45.024423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:45.024856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:45.165061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:45.173222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3f03bef-315d-4efb-af13-5f8e9f07a157 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.165067 Sep 06 11:58:45.173817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 470/979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:45 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:46.197092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:46.197748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:46.204204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:46.204693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:46.205134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:46.205868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:46.206361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:46.206759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:46.337569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:46.345937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-828edcbb-78da-4145-9073-243e406309d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.152677 Sep 06 11:58:46.346515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 510/980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:46 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:47.368492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:47.369055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:47.376399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:47.376886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:47.377325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:47.378049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:47.378508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:47.378939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:47.515904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:47.523746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b0cd9187-c5b8-406e-aec3-d7769141553d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.159203 Sep 06 11:58:47.524317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 471/981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:47 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:48.547913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:48.548463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:48.554980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:48.555469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:48.555906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:48.556607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:48.557067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:48.557496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:48.699334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:48.707333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92828de3-3166-4aee-a292-4aa147414a7d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.163417 Sep 06 11:58:48.707907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 511/982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:48 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:49.730126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:49.730869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:49.737558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:49.738144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:49.738589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:49.739283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:49.739739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:49.740166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:49.875137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:49.883470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eedc90f5-7e55-4d8b-b8ee-cbabced1dc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.157228 Sep 06 11:58:49.884057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 472/983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:49 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:50.908868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:50.909484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:50.916758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:50.917255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:50.918391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:50.919103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:50.919566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:50.920026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:51.054491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:51.062979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e57e242-3dc6-4617-a19a-f63766ed59d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.158040 Sep 06 11:58:51.063587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 512/984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:50 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:52.086531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:52.087093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:52.093495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:52.094024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:52.094467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:52.095167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:52.095609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:52.096033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:52.226149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:52.234540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dd5bb453-d789-4abf-ad6e-4c3650217e47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.151856 Sep 06 11:58:52.235134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 473/985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:52 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:53.257635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:53.258340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:53.266087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:53.266585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:53.267025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:53.267734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:53.268196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:53.268623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:53.407029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:53.414746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a8538987-2dd6-4def-be47-76d095d200c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.160928 Sep 06 11:58:53.415320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 513/986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:53 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:54.438071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:54.438690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:54.445509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:54.446028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:54.446485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:54.447160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:54.447618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:54.448044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:54.578345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:54.585894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-48e8b323-5fc3-4d9f-a861-d4153a7eab5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.151897 Sep 06 11:58:54.586465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 474/987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:54 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:55.610612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:55.611174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:55.617483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:55.618043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:55.618439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:55.619147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:55.619598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:55.620015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:55.757172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:55.765049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0a2f4bf6-970a-46b6-a44f-705b2a511a70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.159295 Sep 06 11:58:55.765613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 514/988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:55 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:56.790824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:56.791628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:56.798823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:56.799298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:56.799728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:56.800415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:56.800863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:56.801284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:56.935222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:56.943129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-382063a2-aa6c-4f59-ba3e-5c7fe98f2ba6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.156200 Sep 06 11:58:56.943704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 475/989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:56 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:57.966916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:57.967558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:57.973634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:57.974262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:57.974707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:57.975402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:57.975860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:57.976291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:58.107680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:58.115446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-38cf3009-95df-491e-84ec-eaa71297a6e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.152926 Sep 06 11:58:58.116023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 515/990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:57 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:58:59.140168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:58:59.140771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:58:59.147182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:59.147668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:59.148094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:59.148776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:58:59.149236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:58:59.149669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:58:59.318871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:58:59.327258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a216a14-7d6d-4c42-8f2a-f35b9df35836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.191340 Sep 06 11:58:59.327839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 476/991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:58:59 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:00.352172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:00.353274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:00.361482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:00.362021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:00.362759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:00.363711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:00.364173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:00.364605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:00.571649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:00.581143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dddbef3f-2463-44e7-89fd-19d27e4f3a61 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1681 microversion: 2.1 time: 0.233426 Sep 06 11:59:00.597889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 516/992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:00 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:00.801522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:00.804266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:00.812608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:00.813588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:00.813811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:00.814592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:00.815139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:00.816282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:00.843688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'flavor' on Instance uuid e8593b18-2abc-4a13-9c4a-3515edd30fd0 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:01.019935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04ffae9a-796f-4d68-bce0-8875c1b306e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/action" status: 200 len: 32 microversion: 2.1 time: 0.223249 Sep 06 11:59:01.020827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 477/993] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:59:00 2022] POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 11:59:01.031420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:01.032134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:01.038804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:01.039393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:01.039897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:01.040696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:01.041392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:01.042046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:01.257139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:01.268399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f45b1659-e44d-4991-a5a9-e59367e4ce50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.242021 Sep 06 11:59:01.273430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 517/994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:01.493370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-1810aeec-b597-4746-b08b-4307f057c8b6 req-219569d3-07db-4558-94f1-7c520d559b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde6a07d-6352-44f1-9e8d-84babe614815", "name": "network-vif-deleted", "tag": "f9f8a407-fbad-4bfe-90d0-a44badb4b76b"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:01.503157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-1810aeec-b597-4746-b08b-4307f057c8b6 req-219569d3-07db-4558-94f1-7c520d559b33 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:01.503905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-1810aeec-b597-4746-b08b-4307f057c8b6 req-219569d3-07db-4558-94f1-7c520d559b33 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:01.504335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-1810aeec-b597-4746-b08b-4307f057c8b6 req-219569d3-07db-4558-94f1-7c520d559b33 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:01.516703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-1810aeec-b597-4746-b08b-4307f057c8b6 req-219569d3-07db-4558-94f1-7c520d559b33 service nova] Creating event network-vif-deleted:f9f8a407-fbad-4bfe-90d0-a44badb4b76b for instance cde6a07d-6352-44f1-9e8d-84babe614815 on hv-cinder-85604 Sep 06 11:59:01.521980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-1810aeec-b597-4746-b08b-4307f057c8b6 req-219569d3-07db-4558-94f1-7c520d559b33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Sep 06 11:59:01.522515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 478/995] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:01.605753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:01.607848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:01.614399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:01.615122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:01.615721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:01.616592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:01.617050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:01.617477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:01.688204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:01.696297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3289717e-1b73-4a2f-ada5-728b91ce4bdb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1613 microversion: 2.1 time: 0.094467 Sep 06 11:59:01.697921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 518/996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:01 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:02.301856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:02.303817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:02.311738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:02.312224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:02.312713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:02.313437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:02.313916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:02.314334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:02.453753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:02.462307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-856f4116-5942-4d95-9700-fc942ba253f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.169829 Sep 06 11:59:02.463118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 479/997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:02.722503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:02.723118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:02.730487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:02.733062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:02.733813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:02.739265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:02.739958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:02.740396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:02.776056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:02.776817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:02.777408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:02.778651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'fault' on Instance uuid cde6a07d-6352-44f1-9e8d-84babe614815 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:02.833798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:02.847594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-382db0cd-f2b4-4654-ab9d-5eb3cbdeec43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1330 microversion: 2.1 time: 0.129164 Sep 06 11:59:02.848338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 519/998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:02 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:03.487410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:03.488127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:03.494814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:03.495300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:03.495939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:03.497451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:03.498142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:03.498573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:03.648806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:03.657587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e033005d-9612-4058-aedf-584618f6dc44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.174191 Sep 06 11:59:03.658385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 480/999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:03.872667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:03.873284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:03.879828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:03.880313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:03.880754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:03.881446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:03.881938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:03.882369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:03.913285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:03.913794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:03.914238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:03.914682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'fault' on Instance uuid cde6a07d-6352-44f1-9e8d-84babe614815 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:03.955141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:03.962978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-828743c1-c9ec-4817-ab89-4d89fe3cf608 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1330 microversion: 2.1 time: 0.094307 Sep 06 11:59:03.963555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 520/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:03 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:04.681663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:04.682357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:04.689398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:04.689915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:04.690358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:04.691050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:04.691518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:04.691944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:04.826870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:04.830404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:04.835800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7930fd9a-56b8-4e1e-82b7-f08ba17a915d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158083 Sep 06 11:59:04.836372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 481/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:04.987570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:04.988187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:04.995025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:04.995783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:04.996316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:04.997718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:04.998349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:04.998778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:05.034589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:05.035146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:05.035536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:05.036645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'fault' on Instance uuid cde6a07d-6352-44f1-9e8d-84babe614815 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:05.092481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:05.096205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:05.101175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-279bea1b-236c-44a3-8609-f299a636cffd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 200 len: 1330 microversion: 2.1 time: 0.117432 Sep 06 11:59:05.101799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 521/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:04 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:05.860713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:05.861321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:05.868815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:05.869299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:05.869767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:05.870486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:05.870934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:05.871351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:06.002690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:06.011015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c15b0224-68bb-4eab-bb50-3aebb0d8bc9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155307 Sep 06 11:59:06.011597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 482/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:06.124841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:06.125548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:06.132376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:06.132865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:06.133305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:06.134042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:06.134505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:06.134936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:06.150614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 HTTP/1.1 Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:59:06.152143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 11:59:06.154423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'cde6a07d-6352-44f1-9e8d-84babe614815'} Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:59:06.155394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 11:59:06.156689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:06.157935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:59:06.157935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-65977dd2-a25b-4333-9579-8ca2a906d55e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 404 len: 111 microversion: 2.1 time: 0.033459 Sep 06 11:59:06.157935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 522/1004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:06 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 11:59:06.163142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34d897ea-8831-4348-bc4d-8c7536993792 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '.version_select at 0x7f97f4e7c550>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:06.187361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34d897ea-8831-4348-bc4d-8c7536993792 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298295942" status: 202 len: 0 microversion: 2.1 time: 0.027960 Sep 06 11:59:06.187930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 483/1005] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 6 11:59:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298295942 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:59:06.890694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:06.891192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:06.897101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:06.897584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:06.898052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:06.898741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:06.899194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:06.899618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:06.980500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'services' on Instance uuid 23cb205f-f79a-4c52-b0e3-190868135839 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:07.035276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:07.036057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:07.044645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:07.045168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:07.045605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:07.046368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:07.046840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:07.047261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:07.054339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88d09c40-a250-4d04-9ac0-f8eb9964eb2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments/a016920c-b2b3-4b24-9fda-8978dc638daf" status: 202 len: 0 microversion: 2.1 time: 0.167532 Sep 06 11:59:07.054929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 523/1006] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 11:59:06 2022] DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments/a016920c-b2b3-4b24-9fda-8978dc638daf => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:59:07.065257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:07.067661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:07.074856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:07.076024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:07.076486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:07.077208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:07.077831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:07.078128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:07.110450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-74d5f71f-7de0-4f97-ab29-ad203e55ac59 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050754 Sep 06 11:59:07.111029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 524/1007] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:07.187506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:07.195736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a28b7045-f86a-4d7b-b9b1-032c8e898436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164345 Sep 06 11:59:07.196311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 484/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:08.123764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:08.125914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:08.132449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:08.132933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:08.133369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:08.134162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:08.134617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:08.135041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:08.166271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-445fa37b-bbde-44c4-b04a-ead7876d3813 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Sep 06 11:59:08.166830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 525/1009] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:08.219870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:08.220597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:08.226987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:08.227468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:08.227902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:08.228722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:08.229181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:08.229703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:08.365756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:08.375526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c8e3b96-f6f5-442c-9b52-c2ad798e9342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160207 Sep 06 11:59:08.376042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 485/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:09.179564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:09.181773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:09.189000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:09.189502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:09.189961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:09.190650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:09.191109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:09.191655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:09.221933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-70e31ea1-e5c1-452d-861f-2bbf8c6ba038 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046347 Sep 06 11:59:09.222496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 526/1011] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:09.399725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:09.400288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:09.406842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:09.407327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:09.407755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:09.408429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:09.408877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:09.409293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:09.546550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:09.554892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-739052f8-3778-41ca-87a1-2d4ca1dbabf5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159070 Sep 06 11:59:09.555474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 486/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:10.235288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:10.237507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:10.243932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:10.244422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:10.244859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:10.245559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:10.246043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:10.246473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:10.280911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2406c343-cf09-4a1b-84b7-ac278852fdc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050351 Sep 06 11:59:10.281469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 527/1013] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:10.577319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:10.577945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:10.584250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:10.584724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:10.585153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:10.585865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:10.586317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:10.586734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:10.715941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:10.724277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5bf54fb1-53c4-4160-824f-125d44940a51 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.150806 Sep 06 11:59:10.724845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 487/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:11.292591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:11.295463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:11.298066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=49 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:11.303217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:11.303702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:11.304142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:11.304833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:11.305288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:11.305740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:11.335587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-533a6dbc-018e-415f-b10f-967b44dfa4c0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046992 Sep 06 11:59:11.336154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 528/1015] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:11.748409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:11.749022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:11.755379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:11.755826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:11.756253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:11.756932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:11.757381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:11.757832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:11.903801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:11.912506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-14ce5f86-9d7e-48cc-8ae7-d924c2afdd07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168073 Sep 06 11:59:11.913100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 488/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:12.347969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:12.350223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:12.356839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:12.357113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:12.357553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:12.358291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:12.358752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:12.359177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:12.390442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-39457891-179e-49b9-b124-c2a43b3ab665 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Sep 06 11:59:12.391010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 529/1017] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:12.936516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:12.937096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:12.943482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:12.943966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:12.944403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:12.945106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:12.945566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:12.946032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:13.075473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:13.083892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e5579ca8-6515-4049-8a28-7ff74e98aa41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151466 Sep 06 11:59:13.084470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 489/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:13.403889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:13.407319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:13.414043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:13.414536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:13.414975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:13.415676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:13.416131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:13.416555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:13.451017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-13ff214e-4b8d-4e78-8d87-ebe093dc81bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051186 Sep 06 11:59:13.452239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 530/1019] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:13.946730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-151237612"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:13.947270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:13.949117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:13.954804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:13.955293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:13.955735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:13.956434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:13.956890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:13.957318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.096915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.network.security_group_api [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Removing security group 02d7ac28-9827-47fe-b1f1-59166501d4f0 from port fef9b85e-f761-4bd9-b17c-5448646f031d Sep 06 11:59:14.109268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:14.110001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:14.116149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.116731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.117297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.118112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.118657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.119156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.266894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:14.275267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e657b13d-d32b-418f-8369-7655386c505a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170923 Sep 06 11:59:14.275852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 531/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:14.355363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:14.355906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:14.362822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.363104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.363469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.364209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.364668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.365187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.400324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-534e18c2-d106-44d2-a179-bafab7c218a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments/680e14de-5886-4336-b76a-757e9f7ff969" status: 200 len: 194 microversion: 2.20 time: 0.049232 Sep 06 11:59:14.401041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 532/1021] 10.222.0.18 () {60 vars in 1454 bytes} [Tue Sep 6 11:59:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments/680e14de-5886-4336-b76a-757e9f7ff969 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:59:14.447249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02d7099f-b4b5-4df7-a5fb-0d3a8af4f4e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.651297 Sep 06 11:59:14.452241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 490/1022] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:59:13 2022] POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:59:14.457523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-676d49ce-ada5-44e0-8a10-b07755f2e939 req-dde9ecb6-a630-474f-bfe6-0b5f426770de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:14.464567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:14.467049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:14.471071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-676d49ce-ada5-44e0-8a10-b07755f2e939 req-dde9ecb6-a630-474f-bfe6-0b5f426770de service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.471478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-676d49ce-ada5-44e0-8a10-b07755f2e939 req-dde9ecb6-a630-474f-bfe6-0b5f426770de service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.472260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-676d49ce-ada5-44e0-8a10-b07755f2e939 req-dde9ecb6-a630-474f-bfe6-0b5f426770de service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.497546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.498442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.499081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.499981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.505248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.506535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.510408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-676d49ce-ada5-44e0-8a10-b07755f2e939 req-dde9ecb6-a630-474f-bfe6-0b5f426770de service nova] Creating event network-changed:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 11:59:14.518303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-676d49ce-ada5-44e0-8a10-b07755f2e939 req-dde9ecb6-a630-474f-bfe6-0b5f426770de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064281 Sep 06 11:59:14.520139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 533/1023] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:14.527344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:14.528046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:14.537324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.538141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.538962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.539990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.540708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.541595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.557843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ab94d058-71bb-4e12-a7e4-49098b5cfade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097159 Sep 06 11:59:14.558818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 491/1024] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:14.666299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lazy-loading 'services' on Instance uuid 0878a748-0471-4506-b2e8-7b3d85289c54 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:14.761056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-be204c2b-ed46-41c6-9261-2953253fff20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments/680e14de-5886-4336-b76a-757e9f7ff969" status: 202 len: 0 microversion: 2.20 time: 0.239247 Sep 06 11:59:14.765957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 534/1025] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Sep 6 11:59:14 2022] DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments/680e14de-5886-4336-b76a-757e9f7ff969 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 11:59:14.771963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:14.774303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:14.786831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.787602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.790395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.794810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:14.795982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:14.796939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:14.869554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0bebf2fc-2c0a-4bbf-8c15-654446364e92 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101898 Sep 06 11:59:14.870499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 492/1026] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:15.304363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:15.305587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:15.313441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.314215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.314846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.315790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.316415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.317006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.468486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:15.480386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-343182a5-effa-4e0e-ac2c-c042c96be3eb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.184681 Sep 06 11:59:15.480983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 535/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:15.579484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:15.581777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:15.588836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.589617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.590087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.590811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.591276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.591692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.627123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a1ea418-1898-495d-b4d7-a0fd3f8e4d2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058629 Sep 06 11:59:15.627722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 493/1028] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:15.888517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:15.893822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:15.906372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.906985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.907530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.909235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.910335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.911546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.913947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:15.914739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:15.921907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.922826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.923495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.924467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:15.925258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:15.925963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:15.960149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eb8ca774-8682-4fcc-94ff-ca8bddce4b7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079890 Sep 06 11:59:15.965951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 536/1029] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:16.024146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lazy-loading 'services' on Instance uuid 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 11:59:16.117040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-512a3226-9dfd-43e0-accc-7ed99de9313c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments/23a53333-4387-4373-b5a6-ea18b241b05f" status: 202 len: 0 microversion: 2.1 time: 0.207034 Sep 06 11:59:16.117804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 494/1030] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 11:59:15 2022] DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments/23a53333-4387-4373-b5a6-ea18b241b05f => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:59:16.129230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:16.132834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:16.143214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.143214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.143806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.144073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.144702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.144944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.180077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bdeb54be-7e6a-4781-82af-d37c5fd1ec29 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057463 Sep 06 11:59:16.180989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 537/1031] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:16.508041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:16.508867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:16.517063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.517575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.518053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.518792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.519252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.519679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.549470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-7560015b-11d9-48e6-a694-456dce72f216 req-ddfbe960-242d-43a3-9894-ac7b7bdfccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:16.561867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-7560015b-11d9-48e6-a694-456dce72f216 req-ddfbe960-242d-43a3-9894-ac7b7bdfccc9 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.562358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-7560015b-11d9-48e6-a694-456dce72f216 req-ddfbe960-242d-43a3-9894-ac7b7bdfccc9 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.562784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-7560015b-11d9-48e6-a694-456dce72f216 req-ddfbe960-242d-43a3-9894-ac7b7bdfccc9 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.576927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-7560015b-11d9-48e6-a694-456dce72f216 req-ddfbe960-242d-43a3-9894-ac7b7bdfccc9 service nova] Creating event network-changed:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 11:59:16.582232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-7560015b-11d9-48e6-a694-456dce72f216 req-ddfbe960-242d-43a3-9894-ac7b7bdfccc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036973 Sep 06 11:59:16.583156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 538/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:16.644772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:16.647488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:16.656100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.656100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.656100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.656857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.657397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.657901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.663205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:16.694803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24d0300f-b34d-4699-bc52-3a6eafe9ba1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055569 Sep 06 11:59:16.695409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 539/1033] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:16.697308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:16.708890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-88c1cfcb-a241-4dec-a700-9c36b302b128 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.205259 Sep 06 11:59:16.710690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 495/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:16.973758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:16.976066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:16.982443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.984666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.985129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:16.985883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:16.986352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:16.986775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.022576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49c4dfc7-049d-48b0-8988-899d0fc0402b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053081 Sep 06 11:59:17.023164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 540/1035] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:17.195728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:17.198289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:17.204730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:17.205264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:17.205758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.206470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:17.206935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:17.207396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.239479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-365e1d66-3cfb-4cfe-a1a4-29e11e0a9b58 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Sep 06 11:59:17.240111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 496/1036] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:17.708423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:17.710638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:17.717955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:17.718305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:17.718773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.719475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:17.719933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:17.720359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.733525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:17.734254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:17.740640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:17.741225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:17.741581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.742318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:17.742781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:17.743213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:17.753171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e05f15b-3ec0-49f4-88e1-decb23169364 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049146 Sep 06 11:59:17.753977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 541/1037] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:17.879838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:17.888298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e7293fb-754c-4bcd-a27d-5d7439dac5c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158672 Sep 06 11:59:17.888884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 497/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:18.036352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:18.038443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:18.044485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.044966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.045447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.046528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.046990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.047421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.078175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dd2440e1-27a7-46df-9650-96baf39f378d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046028 Sep 06 11:59:18.078748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 542/1039] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:18.253298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:18.255381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:18.261820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.262321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.262766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.263471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.265806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.265954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.295758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63e9f326-b45f-4dc6-9c36-1e89eeb568aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Sep 06 11:59:18.296430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 498/1040] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:18.766683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:18.769178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:18.775676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.776163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.776601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.777300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.777798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.778226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.809376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c4dac87e-340e-4c04-b6ce-3acf5f22515a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Sep 06 11:59:18.810054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 543/1041] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:18.913971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:18.914588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:18.921549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.922067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.922509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.923209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:18.923672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:18.924088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:18.928366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:19.062412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:19.070894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-af3d02a3-8070-458d-a978-fdd9b8a883be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160727 Sep 06 11:59:19.071489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 499/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:19.091030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:19.094040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:19.100444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:19.100936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:19.101378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:19.102130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:19.102594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:19.103025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:19.138578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-75c245bc-6dd8-4b52-8817-f13429e8f8dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051840 Sep 06 11:59:19.140098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 544/1043] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:19.308980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:19.311772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:19.318120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:19.318601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:19.319038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:19.319733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:19.320188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:19.320609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:19.352687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8a98f5cc-b6e4-43b1-925d-24d4f44ade05 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Sep 06 11:59:19.353263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 500/1044] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:19.822534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:19.824831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:19.832295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:19.832778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:19.833217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:19.833949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:19.834405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:19.834829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:19.867006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-13a2f9bb-276f-43a8-bedf-3b5608fbe092 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 Sep 06 11:59:19.867599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 545/1045] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:20.095623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:20.096226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:20.102704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.103189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.103629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.104322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.104786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.105214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.151842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:20.154022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:20.160329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.160812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.161241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.162036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.162489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.162914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.199535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4747d730-034e-4192-a690-cefe510e7bcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051739 Sep 06 11:59:20.200138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 546/1046] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:20.251003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:20.260092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6a32e12d-ea9e-42e6-8791-a15e073897de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168423 Sep 06 11:59:20.260694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 501/1047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:20.365508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:20.367649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:20.373912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.374405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.374932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.375607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.376116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.376543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.407962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-474f1050-6da7-41c5-bf37-aa976757803e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 Sep 06 11:59:20.408547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 547/1048] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:20.879824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:20.881992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:20.888533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.889933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.891061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.891849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:20.892640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:20.893379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:20.930410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02755fc9-5b0a-4997-979d-069c2e9fda77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054535 Sep 06 11:59:20.931007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 502/1049] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:21.211479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:21.213621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:21.220068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.220546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.220976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.221664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.222125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.222546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.252240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-48879d9b-7907-43ce-a3e2-ca91e2696a72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044687 Sep 06 11:59:21.253169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 548/1050] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:21.283906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:21.284513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:21.290845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.291325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.291760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.292446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.292900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.293328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.421131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:21.423369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:21.424146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:21.429556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.430074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.430512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.431216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.431669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.432127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.432322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a443529-e3f0-4b67-bf2a-969f6ebe401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152353 Sep 06 11:59:21.433087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 503/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:21.461546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c07939d1-174a-4dc0-83c3-01a678737219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Sep 06 11:59:21.462133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 549/1052] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:21.943005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:21.945523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:21.951760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.952253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.952922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.953855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:21.954347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:21.954773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:21.986770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09699444-8bc7-4a4c-8168-3055f022d6f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047701 Sep 06 11:59:21.987358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 504/1053] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:22.269260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:22.272479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:22.282719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:22.283214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:22.283649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:22.284360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:22.284818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:22.285250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:22.320930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ddf51666-4120-475f-ba18-41ee39e551b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059964 Sep 06 11:59:22.321515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 550/1054] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:22.456861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:22.457474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:22.466465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:22.466956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:22.467490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:22.468248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:22.468777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:22.469443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:22.474775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:22.476974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:22.483974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:22.484467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:22.484913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:22.485626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:22.486117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:22.486554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:22.517766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af0a89c2-9199-49d4-978f-e7f69a6c0041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047510 Sep 06 11:59:22.518479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 551/1055] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:22.607108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:22.616235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b2c97de-45b8-4a83-962c-f91c82b15022 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163408 Sep 06 11:59:22.616810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 505/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:22.999380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:23.001570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:23.007596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.008086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.008522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.009218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.009697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.010153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.041020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5bae19f9-2c7e-4f58-9e5e-ff3604c6d0f9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Sep 06 11:59:23.041584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 552/1057] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:23.334400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:23.336557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:23.342667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.343164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.343607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.344307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.344765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.345192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.383518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d2668c7-53fb-452b-9d88-444257a5bd55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053146 Sep 06 11:59:23.384092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 506/1058] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:23.530906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:23.533046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:23.540054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.540614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.541054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.541951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.542438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.542866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.581345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a0895901-b430-4178-a5f3-ea0617864c0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054997 Sep 06 11:59:23.581999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 553/1059] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:23.638935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:23.640586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:23.646974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.647459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.647895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.648591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:23.649050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:23.649479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:23.785921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:23.794133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a9225dfe-c795-4d03-9db6-f0bbe7024848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159096 Sep 06 11:59:23.794704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 507/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:24.053032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:24.055145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:24.061638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.062415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.062623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.063342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.063833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.064268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.097509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ec03b16b-3d31-4a28-b06e-f040ee5c8781 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048426 Sep 06 11:59:24.098157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 554/1061] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:24.398392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:24.400559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:24.407327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.407812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.408253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.408957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.409409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.409869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.440219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9f6cc5ff-33d5-4035-944f-cba7ffc0e8a5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045968 Sep 06 11:59:24.440806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 508/1062] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:24.594964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:24.597158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:24.604090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.604569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.605002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.605732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.606196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.606621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.633467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:24.639676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-82eb7d41-349f-4109-86a2-2e300252bcfd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048754 Sep 06 11:59:24.640545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 555/1063] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:24.819288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:24.820299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:24.826608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.827726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.828202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.828904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:24.829360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:24.829811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:24.967829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:24.976336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-14417c55-afb2-4ebd-90fe-871d39b0affc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161286 Sep 06 11:59:24.976918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 509/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:25.110385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:25.112513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:25.118657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:25.119155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:25.119600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:25.120304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:25.120765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:25.121193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:25.155734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d4f2bf7b-f5d9-42f1-847b-71cce7bddc7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049858 Sep 06 11:59:25.156308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 556/1065] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:25.454039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:25.456601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:25.462980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:25.463473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:25.463911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:25.464626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:25.465086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:25.465513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:25.501781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8f71bdf4-d63d-4cc7-9cf7-166027648f1c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052598 Sep 06 11:59:25.502390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 510/1066] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:25.652974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:25.655920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:25.662760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:25.663274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:25.663696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:25.664408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:25.664862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:25.665290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:25.697465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f581dd4-b24f-4a2b-9042-acd51df8de1c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048777 Sep 06 11:59:25.698087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 557/1067] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:26.000200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:26.000908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:26.007597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.008083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.008524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.009226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.009708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.010136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.161679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:26.167713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:26.169946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:26.176298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.176801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.177244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.177994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.178451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.178889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.180155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4af1cc9a-f5f9-445d-bb63-feb0e17c401f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.184576 Sep 06 11:59:26.180759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 511/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:26.212423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d1bca9cb-788b-41b2-ac1c-506158789e6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048624 Sep 06 11:59:26.213000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 558/1069] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:26.516063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:26.518321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:26.524982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.525482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.525950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.526663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.527117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.527538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.561597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ded7b83-ee37-4995-bc42-231f766bc466 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050315 Sep 06 11:59:26.562436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 512/1070] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:26.713126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:26.716675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:26.724736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.725372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.725848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.726774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:26.727294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:26.727721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:26.761008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e681c885-d386-4576-8cdc-ea9f378af4bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053878 Sep 06 11:59:26.761614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 559/1071] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:27.205284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:27.205940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:27.212734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.213264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.213760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.214471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.214931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.215363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.225018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:27.227347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:27.234676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.235172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.235624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.236327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.236785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.237216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.272394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd534d2c-5ceb-454a-94ba-ea6330cc4a5e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051431 Sep 06 11:59:27.272991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 560/1072] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:27.366971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:27.376397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-07fc3c43-bcdc-43e5-b8f5-c4c2de2c67dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.175653 Sep 06 11:59:27.377038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 513/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:27.575902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:27.579111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:27.585333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.585863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.586297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.587000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.587452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.587869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.622283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ff925f1-ff48-40b4-b833-bf4ddbcd7bdc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050920 Sep 06 11:59:27.622777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 561/1074] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:27.774381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:27.776587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:27.783737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.784223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.784660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.785358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:27.785840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:27.786267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:27.817232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0bf71d1-4732-4e4a-9f3e-e518d780f3ed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046877 Sep 06 11:59:27.817832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 514/1075] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:28.287252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:28.289436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:28.296800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.297289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.297766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.298481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.298942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.299367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.332230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e798784-22da-428f-ab8f-6e2e8aa595c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049010 Sep 06 11:59:28.332850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 562/1076] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:28.401307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:28.401941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:28.408684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.409199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.409618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.410354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.410805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.411233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.551989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:28.555763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:28.563020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8be1adce-20a6-4032-9869-eecde0082d4b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164824 Sep 06 11:59:28.563665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 515/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:28.635523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:28.637809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:28.645035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.645533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.646009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.646720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.647180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.647610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.681884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cc2cd1d5-4c3a-4a8c-af13-521a3421a468 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050428 Sep 06 11:59:28.682551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 563/1078] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:28.830538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:28.832585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:28.838639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.839113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.839540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.840216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:28.840659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:28.841079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:28.871940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3821333d-fb0d-4dea-b8b1-803e4f845ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Sep 06 11:59:28.872500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 516/1079] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:29.344958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:29.347178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:29.354147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.354637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.355081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.355803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.356264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.356695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.390492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e0ce6b9a-59d5-4ce0-a907-d2aaf610a7fa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048712 Sep 06 11:59:29.391093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 564/1080] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:29.586902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:29.587514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:29.594885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.595417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.595803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.596489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.596940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.597359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.694823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:29.697022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:29.704420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.704919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.705358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.706162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.706621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.707046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.735189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:29.738464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0aa27d5a-8cfb-436a-a543-5d609c5c76b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047659 Sep 06 11:59:29.739031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 565/1081] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:59:29.743803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3de8abde-2c23-49f6-bcc2-5f6c9089a4e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160791 Sep 06 11:59:29.744382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 517/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:29.884117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:29.886248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:29.894842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.895338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.895779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.896483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:29.896938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:29.897369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:29.937417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-01c43a9b-f4a2-4207-b4cb-e30b8489b6dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057407 Sep 06 11:59:29.938041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 566/1083] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:30.404343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:30.406872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:30.412888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.413362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.413831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.414517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.414965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.415383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.446562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-25754f74-ff51-4442-a8ba-460d7757e4e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Sep 06 11:59:30.447138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 518/1084] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:30.751894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:30.754096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:30.760493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.760969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.761395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.762113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.762559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.762981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.767012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:30.767658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:30.774822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.775314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.775793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.776493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.776953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.777382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.793024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7db773fa-c852-4768-92e1-bc10e77de561 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045707 Sep 06 11:59:30.793636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 567/1085] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:30.914375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:30.922608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4be2e899-f1dc-4fec-bb44-8558906ce480 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159789 Sep 06 11:59:30.923188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 519/1086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:30.950119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:30.953029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:30.964023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.964518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.964957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:30.965680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:30.966142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:30.966567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.003773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0322186e-2193-40d5-893b-8ac73a7e6e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057495 Sep 06 11:59:31.004269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 568/1087] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:31.459498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:31.461631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:31.468430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.468920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.469354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.470092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.470634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.471061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.510968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d2c4f8b-b980-4f87-8f9e-688d11d77211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055317 Sep 06 11:59:31.511454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 520/1088] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:31.806746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:31.808796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:31.815950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.816430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.816861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.817546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.818091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.818518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.847480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21d1748a-5693-49e2-8886-c405141b2ac2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044771 Sep 06 11:59:31.848034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 569/1089] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:31.947949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:31.948558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:31.955394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.955879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.956313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:31.956999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:31.957453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:31.957907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.016499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:32.018689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:32.025016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.025504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.025970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.026725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.027129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.027540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.058663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fdc557f9-ae70-49cc-a6f5-5b170d3dfa8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Sep 06 11:59:32.059167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 570/1090] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:32.093677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:32.102250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-46097d3b-561a-470a-8c6e-320731b3f12c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158121 Sep 06 11:59:32.102830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 521/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:32.524504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:32.526729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:32.533691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.534188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.534629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.535358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.535836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.536263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.567101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-46b18c58-c79f-4924-b0cd-5d4ddcdfde9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Sep 06 11:59:32.567691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 571/1092] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:32.860335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:32.862384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:32.868271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.868744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.869175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.869882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:32.870329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:32.870746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:32.900584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f921694-f90b-4b9c-862e-2f3c469ba273 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044258 Sep 06 11:59:32.901139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 522/1093] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:33.071208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:33.073392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:33.080959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.081446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.081907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.082601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.083100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.083478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.107386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:33.121408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-090b4e0d-3955-43c2-98a8-817440c18485 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054092 Sep 06 11:59:33.122177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 572/1094] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:33.127742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:33.128365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:33.135105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.135599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.136038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.136793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.137258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.137722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.268590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:33.276780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc19e339-344d-48f8-8313-64effcd55adb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154691 Sep 06 11:59:33.277341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 523/1095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:33.581157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:33.583371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:33.589316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.589846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.590282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.590979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.591434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.591865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.621308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-48bb4383-231c-4164-8e8e-91f8c3dca9a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Sep 06 11:59:33.621889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 573/1096] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:33.913515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:33.915692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:33.921545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.930675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.930675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.930675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:33.930675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:33.931169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:33.956035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-97fd3603-55e8-4943-89d3-466ab1a668b2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046451 Sep 06 11:59:33.956591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 524/1097] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:34.135238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.137399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.144269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.144751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.145191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.145908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.146363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.146789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.176166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b73b799a-ec94-4602-9a63-51c9cb0729af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Sep 06 11:59:34.176653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 574/1098] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:34.300909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.301523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.307974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.308458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.308928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.309622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.310118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.310547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.445153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:34.453570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-863b62e7-7659-4053-b589-7ef3a6ab5eb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1715 microversion: 2.1 time: 0.156924 Sep 06 11:59:34.454413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 525/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:34.517401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.517944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.523892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.524373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.524804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.525488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.525969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.526387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.607841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] HTTP exception thrown: Cannot 'detach_volume' instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 while it is in vm_state rescued Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Request method failure captured: Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments/0fd8d628-e705-477b-b3fa-399ef5fe20ec HTTP/1.1 Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP8WhChmO0e747b94LLsv4KV_p1rCUXE932zqUOAR-UE2UtrNZCN0tbUBjL-WFeDraD4XTNQjdd93nctg0ubt0PCEJlAskaXtNvL_FtcYEd3DWYFBXAnyeG32oQm549hSGwUJJjmoxkUxn8TyQxBjR7moTn5NqLQ26v7kR2Gh3P1mU Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 11:59:34.609548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ef6b481491244111a479eb91e3594ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}] Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 41bc35497fe94ababe0c824a429168d3 Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 11:59:34.611336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Cannot 'detach_volume' instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 while it is in vm_state rescued Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'server_id': 'e8593b18-2abc-4a13-9c4a-3515edd30fd0', 'id': '0fd8d628-e705-477b-b3fa-399ef5fe20ec'} Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 11:59:34.612283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 while it is in vm_state rescued Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 while it is in vm_state rescued Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 11:59:34.613840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Returning 409 to user: Cannot 'detach_volume' instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 while it is in vm_state rescued {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 11:59:34.615197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-724956db-5aa8-4c79-a2d1-02bd4fe2eac4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments/0fd8d628-e705-477b-b3fa-399ef5fe20ec" status: 409 len: 152 microversion: 2.1 time: 0.098519 Sep 06 11:59:34.615197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 575/1100] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 11:59:34 2022] DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments/0fd8d628-e705-477b-b3fa-399ef5fe20ec => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 11:59:34.619894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:34.620426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.626866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.627356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.627800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.628516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.628977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.629414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.634850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.637077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.645123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.645612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.646086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.646791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.647251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.647679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.677537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca12ef55-68fc-4155-a200-fde88d51f51f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Sep 06 11:59:34.678193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 576/1101] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:34.697687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c2f9d78e-7e46-4f7c-8b2a-eb6a157c991d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/action" status: 202 len: 0 microversion: 2.1 time: 0.081427 Sep 06 11:59:34.701252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 526/1102] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 11:59:34 2022] POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 11:59:34.708062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.708688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.715440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.716002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.716445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.717390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.718805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.720172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.939988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:34.948797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4573d63-5a73-427a-8d08-a5c08b27bd9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1723 microversion: 2.1 time: 0.245325 Sep 06 11:59:34.949301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 577/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 11:59:34.971220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:34.973506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:34.979902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.980398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.980840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:34.982559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:34.982559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:34.982559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.018204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92bb90e2-b02e-4f27-89fd-feb10a3aa7a4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052063 Sep 06 11:59:35.018954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 527/1104] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:35.189402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:35.191648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:35.194374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:35.199838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.200250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.200686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.201385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.201872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.202293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.233763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a7dc82d-d635-4343-b490-a48d502e1ccf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049088 Sep 06 11:59:35.234449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 578/1105] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:35.692035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:35.694194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:35.700516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.700992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.701429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.702147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.702595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.703019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.733470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e972e9c7-4af4-45b6-a4ee-84bf78430dd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 Sep 06 11:59:35.733981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 528/1106] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:35.972885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:35.973227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:35.979273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.979746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.980179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:35.980874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:35.981330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:35.981781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.030560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:36.032958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:36.039118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.039682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.040177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.040871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.041373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.041782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.073570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8e41660c-3e80-4761-965c-407eee569a71 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047019 Sep 06 11:59:36.074227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 529/1107] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:59:36.121384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:36.130429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f2538015-bef2-4fd9-be24-912c37a5125c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1723 microversion: 2.1 time: 0.161901 Sep 06 11:59:36.131011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 579/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:36.246762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:36.248914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:36.255955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.256432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.256864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.257562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.258048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.258551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.287781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92a17fd0-f387-4422-93f9-453b6480357f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Sep 06 11:59:36.288263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 530/1109] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:36.746877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:36.749029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:36.755384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.755861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.756289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.756968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:36.757414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:36.757867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:36.787446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-77861485-8dab-4b92-9dc2-bcb52d20f529 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Sep 06 11:59:36.787998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 580/1110] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:37.086686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:37.088838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:37.096663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.097156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.097597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.098343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.098797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.099226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.118869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:37.134908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-479ae607-57e2-4f86-9725-66d8992d01b5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052380 Sep 06 11:59:37.135678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 531/1111] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:37.154078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:37.154695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:37.162275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.162767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.163211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.163913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.164369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.164791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.300707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:37.303068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:37.309167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.309667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.310127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.310831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.311285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.311709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.314570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:37.323086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-47ec6f77-4f91-4b7d-af7b-926c806a03a2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1723 microversion: 2.1 time: 0.172752 Sep 06 11:59:37.323677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 581/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:37.343425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-94e104ba-a2b4-4152-a4b4-e464010437b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Sep 06 11:59:37.344184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 532/1113] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:37.800562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:37.802787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:37.809222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.809759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.810267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.810905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:37.811364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:37.811797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:37.841492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b4f1b888-9d54-4ad5-a600-63ec6e68868c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Sep 06 11:59:37.842138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 582/1114] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:38.147937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:38.150114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:38.157025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.157716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.158169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.158864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.159326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.159746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.190145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b651d017-b846-48bf-86fc-f72e3affbf2f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046113 Sep 06 11:59:38.190707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 533/1115] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:38.348421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:38.349078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:38.355430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.355946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.356384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.356822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:38.357086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.357539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.357994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.359621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:38.366444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.366826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.367338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.367960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.368411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.368832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.412542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62bf11cb-2cfa-461f-98d6-d69ae06e9256 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060523 Sep 06 11:59:38.413339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 534/1116] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:38.506495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:38.515081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-15fe632f-4b4a-4ece-8320-119eb30d1880 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1723 microversion: 2.1 time: 0.171751 Sep 06 11:59:38.516470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 583/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:38.854502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:38.856609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:38.862956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.863433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.863864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.864553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:38.864997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:38.865416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:38.895660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d08aa093-0ea8-4a2a-b5a9-4fc78ed1da39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Sep 06 11:59:38.896225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 535/1118] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:39.202247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:39.204615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:39.211284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.211773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.212227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.212912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.213362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.213813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.244304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3744c7b5-ca6e-4497-acf2-bb494c2c7dc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045982 Sep 06 11:59:39.244869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 584/1119] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 11:59:39.426813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:39.428976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:39.435275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.435766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.436204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.436903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.437355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.438423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.471483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3f1320e5-069b-4bf3-88c0-34c6ce2672ac tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049193 Sep 06 11:59:39.472075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 536/1120] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:39.540062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:39.540672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:39.546753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.547951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.548386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.549071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.549524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.550004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.687794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 11:59:39.696616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50145032-9159-458f-946b-028922b4027c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1729 microversion: 2.1 time: 0.160333 Sep 06 11:59:39.697671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 585/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 11:59:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 11:59:39.720833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:39.722166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:39.728588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.729082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.729530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.730264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.730728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.731161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.825954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c2776884-77ef-49ff-8950-1dda10e2266c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109417 Sep 06 11:59:39.826596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 537/1122] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 11:59:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:39.909403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:39.911712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:39.917888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.918378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.918816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.919514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:39.919964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:39.920384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:39.952082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-856782f9-5167-403d-b74e-f2b81d448b3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047380 Sep 06 11:59:39.952895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 586/1123] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:40.257556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:40.259719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:40.266614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.267087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.267515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.268203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.268645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.269060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.299326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62e7e75b-8e9d-4663-956f-81085484b2a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045705 Sep 06 11:59:40.299897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 538/1124] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:40.484050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:40.486420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:40.493046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.493538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.494014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.494721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.495182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.495610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.527388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f93c303-f624-4036-ad30-fbb6cfd601a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Sep 06 11:59:40.527964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 587/1125] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:40.957292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-b5351b7f-3ae6-442f-b1ec-e39c930ca5fd req-f58776dd-5eca-4c01-8a7a-5dd33d3e3973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:40.964781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:40.974308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:40.981049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.981636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.982177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.982388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b5351b7f-3ae6-442f-b1ec-e39c930ca5fd req-f58776dd-5eca-4c01-8a7a-5dd33d3e3973 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.982794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b5351b7f-3ae6-442f-b1ec-e39c930ca5fd req-f58776dd-5eca-4c01-8a7a-5dd33d3e3973 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.982981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:40.983215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b5351b7f-3ae6-442f-b1ec-e39c930ca5fd req-f58776dd-5eca-4c01-8a7a-5dd33d3e3973 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:40.983593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:40.984104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.000409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-b5351b7f-3ae6-442f-b1ec-e39c930ca5fd req-f58776dd-5eca-4c01-8a7a-5dd33d3e3973 service nova] Creating event network-changed:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 11:59:41.008924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-b5351b7f-3ae6-442f-b1ec-e39c930ca5fd req-f58776dd-5eca-4c01-8a7a-5dd33d3e3973 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054083 Sep 06 11:59:41.008924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 539/1126] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:41.028851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36939c7d-b4a3-4881-9464-5f18ae93f00b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067979 Sep 06 11:59:41.029533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 588/1127] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:41.313894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:41.316634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:41.318800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:41.325933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:41.326445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:41.326892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.327617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:41.328591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:41.329619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.360913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b6dcd25-4bd8-4850-9365-ff1b671badd3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052336 Sep 06 11:59:41.367129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 540/1128] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:41.540699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:41.542863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:41.550191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:41.550984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:41.551422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.552132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:41.552586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:41.553006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:41.556853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:41.585553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-70cbc536-d5a9-4b18-89d5-57858884f05c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048820 Sep 06 11:59:41.586157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 589/1129] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:42.043173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:42.045339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:42.053991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.054420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.055012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.055833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.056284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.056705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.089737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-359f01fd-e09d-4574-a5b2-3d816a9844ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050706 Sep 06 11:59:42.090432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 541/1130] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:42.375986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:42.378112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:42.384328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.384819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.385258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.385997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.386453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.386879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.418017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2e567a24-5a13-42fb-aa42-15f8346487c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046865 Sep 06 11:59:42.418597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 590/1131] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:42.598664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:42.600795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:42.607316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.607794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.608222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.608912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:42.609487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:42.610558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:42.642899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-57f9a770-3d3d-40af-be36-ea3d78b7da98 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048737 Sep 06 11:59:42.643397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 542/1132] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:43.023942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-86de8a13-91fa-447d-b112-6b3739491101 req-59cd7e42-cfa3-4b54-a3ef-f50a627bd35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 11:59:43.034802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-86de8a13-91fa-447d-b112-6b3739491101 req-59cd7e42-cfa3-4b54-a3ef-f50a627bd35c service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.035282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-86de8a13-91fa-447d-b112-6b3739491101 req-59cd7e42-cfa3-4b54-a3ef-f50a627bd35c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.035719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-86de8a13-91fa-447d-b112-6b3739491101 req-59cd7e42-cfa3-4b54-a3ef-f50a627bd35c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.047630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-86de8a13-91fa-447d-b112-6b3739491101 req-59cd7e42-cfa3-4b54-a3ef-f50a627bd35c service nova] Creating event network-changed:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 11:59:43.052794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-86de8a13-91fa-447d-b112-6b3739491101 req-59cd7e42-cfa3-4b54-a3ef-f50a627bd35c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Sep 06 11:59:43.053393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 591/1133] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 11:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:43.104492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:43.107615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:43.114988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.115790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.115912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.116602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.117053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.117478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.149615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63d632b7-cd66-4f79-ac59-d7952af6dc0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050746 Sep 06 11:59:43.150301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 543/1134] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:43.432116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:43.434433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:43.441298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.441818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.442260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.442971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.443434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.443864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.478133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4f7cd179-dd1d-4b4e-b6ff-e445c93ede81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050484 Sep 06 11:59:43.478927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 592/1135] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:43.655322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:43.658249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:43.664237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.664723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.665160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.665888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:43.666344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:43.666768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:43.697039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e77359c1-b3f1-4349-8523-23c3c2cd95c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045513 Sep 06 11:59:43.697537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 544/1136] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:44.163179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:44.165442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:44.173617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.174138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.174581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.175294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.175757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.176188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.209567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-05be38ba-3d4e-44f0-964a-740cb4881811 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050416 Sep 06 11:59:44.210209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 593/1137] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:44.491687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:44.493926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:44.500812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.501308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.501838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.502507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.502961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.503387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.536008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc621f78-943a-4f77-a726-733caa26149d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048479 Sep 06 11:59:44.536603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 545/1138] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:44.709636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:44.711860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:44.718005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.718497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.719423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.720332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:44.720796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:44.721227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:44.752460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a2c88994-4d68-4fa2-a9ba-1b7c83b37b52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Sep 06 11:59:44.752940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 594/1139] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:45.222025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:45.224195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:45.230349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:45.230830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:45.231261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.231943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:45.232390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:45.232809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.262599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71d05bbe-2ac0-41a5-95b9-4a251f6893b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Sep 06 11:59:45.263104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 546/1140] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:45.548857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:45.551117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:45.557886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:45.558378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:45.558820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.559523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:45.559984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:45.560411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.591401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6621158c-1998-4bb3-8dda-96fd028c6150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046658 Sep 06 11:59:45.592176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 595/1141] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:45.764846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:45.768203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:45.774698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:45.775181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:45.775623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.776355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:45.776809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:45.777235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:45.806288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f6c8794-f3aa-46ad-94f1-06be8bca6fb1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045371 Sep 06 11:59:45.806769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 547/1142] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:46.275588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:46.277801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:46.284512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.285000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.285441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.286172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.286649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.287079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.316481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6bea44e9-8297-4099-bc54-7e60031f2f69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Sep 06 11:59:46.317038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 596/1143] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:46.604551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:46.606743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:46.612788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.613274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.613734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.614449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.614904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.615328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.646023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5996ac52-92f2-4b9a-a99a-b99379a04d72 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045362 Sep 06 11:59:46.646602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 548/1144] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:46.818769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:46.820897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:46.827788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.828263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.829191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.830159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:46.830610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:46.831032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:46.860398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1694f92a-0fa4-45ab-a59f-702f96459ec6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Sep 06 11:59:46.860875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 597/1145] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:47.329588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:47.331724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:47.338145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.338620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.339049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.339735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.340182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.340600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.344240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:47.370346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2dfc54a3-6606-4ee3-98b4-0b5f60f9b009 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Sep 06 11:59:47.370905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 549/1146] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:47.659745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:47.661980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:47.668013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.668499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.668943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.669658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.670127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.670555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.700869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-11ca5cf9-e5c0-4120-9d17-569598075f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045846 Sep 06 11:59:47.701436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 598/1147] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:47.872790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:47.874993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:47.881445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.881951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.882386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.883062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:47.883508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:47.883922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:47.912817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-49b31319-88a8-4a1e-bc46-164ff7543782 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Sep 06 11:59:47.913296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 550/1148] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:48.383246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.385402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:48.392733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.393213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.393670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.394370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.394822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.395243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.426801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-19c8fd99-d24c-470b-831a-21dc6a6e21e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Sep 06 11:59:48.427369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 599/1149] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:48.714124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.716306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:48.723704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.724192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.724633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.725342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.725833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.726442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.757627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3da56f1e-ee88-4d73-be4e-9b68b695e16a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047589 Sep 06 11:59:48.758232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 551/1150] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:48.932395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:48.934629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:48.940862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.941348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.941831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.942532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:48.942985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:48.943401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:48.973106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f926beba-493f-4e51-a709-aafde4136381 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052348 Sep 06 11:59:48.973579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 600/1151] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:49.439998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:49.442214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:49.448153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:49.448633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:49.449075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:49.449786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:49.450238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:49.450658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:49.480828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0e474f7-afdf-4ba6-993d-58484f76fae2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Sep 06 11:59:49.481387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 552/1152] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:49.770663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:49.772837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:49.779284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:49.779766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:49.780202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:49.780893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:49.781387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:49.782589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:49.812619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-12e78925-0dcf-4238-94d1-990a5f1eb0f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046731 Sep 06 11:59:49.814319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 601/1153] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:49.985978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:49.988150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:49.994585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:49.995070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:49.995519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:49.996216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:49.996741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:49.997097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:50.027275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5095781b-7dc8-4e05-87a4-f08b7e31b127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Sep 06 11:59:50.027774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 553/1154] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:50.493778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:50.496015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:50.502515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:50.503014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:50.503455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:50.504154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:50.504614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:50.505046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:50.535896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-39b1d335-bf2a-40f4-bd0b-4f581eba209a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Sep 06 11:59:50.536464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 602/1155] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:50.826455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:50.829199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:50.835242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:50.835729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:50.836172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:50.836867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:50.837322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:50.837775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:50.868794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6c80c671-e0df-4e3f-923a-e3faeed64567 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046242 Sep 06 11:59:50.869397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 554/1156] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:51.040396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:51.042756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:51.050176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.050670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.051126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.051831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.052288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.052726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.083715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-25e0a864-5084-480f-9cac-5237507f9c6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Sep 06 11:59:51.084208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 603/1157] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:51.548753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:51.551023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:51.561445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.562451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.563819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.565143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.566095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.566927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.601866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3c5d1a5-eb50-43ed-a648-f2603fe87001 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057348 Sep 06 11:59:51.602467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 555/1158] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:51.883409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:51.885794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:51.892635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.893142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.893584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.894424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:51.894939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:51.895416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:51.928517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efd346a7-7e61-4edf-93f3-295d82abef04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049600 Sep 06 11:59:51.929201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 604/1159] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:52.096454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:52.098652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:52.104632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:52.105113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:52.105551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.106280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:52.106734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:52.107158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.136719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2a3e6d12-4476-4c2a-977b-4ddb94815a36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Sep 06 11:59:52.137206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 556/1160] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:52.614401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:52.616647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:52.623178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:52.623669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:52.624107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.624808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:52.625269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:52.626354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.656737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88c582ed-1386-4690-a206-dbfbe0784bc6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046861 Sep 06 11:59:52.657304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 605/1161] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:52.941520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:52.943654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:52.950119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:52.950578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:52.951006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.951688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:52.952131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:52.952548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:52.982046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-78e2fbac-72c9-486f-997a-25f7b0667181 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Sep 06 11:59:52.982599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 557/1162] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:53.149284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:53.151471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:53.158580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:53.159064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:53.159510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:53.160197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:53.160650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:53.161073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:53.179797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:53.193590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-170c936f-c4ae-40fc-908a-c819aaa53538 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047805 Sep 06 11:59:53.194112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 606/1163] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:53.668487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:53.670663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:53.676625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:53.677141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:53.677580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:53.678297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:53.678752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:53.679181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:53.709048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1280b590-9fcf-498d-b1b8-1e6737a0d6b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Sep 06 11:59:53.709612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 558/1164] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:53.995719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:53.997926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:54.005614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:54.006116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:54.006551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:54.007246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:54.007696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:54.008119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:54.040071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dcb5e470-a375-4cdd-8fb0-67bce6d069e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048647 Sep 06 11:59:54.040641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 607/1165] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:54.206735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:54.208851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:54.215316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:54.215786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:54.216210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:54.216914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:54.217360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:54.217804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:54.251273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-86a1c22e-b7aa-4d52-a27d-ac782124d63e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048890 Sep 06 11:59:54.252138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 559/1166] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 11:59:54.721622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:54.723780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:54.729791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:54.730269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:54.730699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:54.731376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:54.731822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:54.732237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:54.761568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-745e88ca-31b2-4c50-b017-fb21dabdb170 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Sep 06 11:59:54.762150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 608/1167] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:55.053704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:55.055873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:55.061929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:55.062420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:55.062862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:55.063551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:55.064007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:55.064439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:55.094539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cf754329-4364-4684-aa77-a3eef15bb583 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045738 Sep 06 11:59:55.095098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 560/1168] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:55.264379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:55.266854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:55.273364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:55.273890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:55.274332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:55.275363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:55.275487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:55.275907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:55.306266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5211dfdb-8e73-4087-99b3-0fabfb495d6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Sep 06 11:59:55.306758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 609/1169] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:55.774983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:55.777243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:55.784424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:55.784918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:55.785359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:55.786082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:55.786538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:55.786964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:55.816956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc0e369c-dd4e-4c72-8241-22838a120914 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Sep 06 11:59:55.817558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 561/1170] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:56.107435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:56.109602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:56.116574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:56.117064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:56.117502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:56.118224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:56.118676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:56.119134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:56.150558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6874d13b-ed8c-4dd4-b348-6ff418c5e065 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047122 Sep 06 11:59:56.151125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 610/1171] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:56.319948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:56.322161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:56.328046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:56.328520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:56.328948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:56.329628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:56.330091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:56.330507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:56.360129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9f250936-e8e0-4ce9-9c9a-9d34d5844bdc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Sep 06 11:59:56.360654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 562/1172] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:56.829570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:56.832335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:56.838534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:56.839020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:56.839453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:56.840148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:56.840599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:56.841021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:56.872857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-83f0a1b3-29a0-4e83-bd52-e3f8973428fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Sep 06 11:59:56.873424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 611/1173] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:57.163842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:57.165994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:57.172910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:57.173395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:57.173852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:57.174575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:57.175022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:57.175434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:57.211310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1bc33265-604f-436b-b13a-1d44b5edf26a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051416 Sep 06 11:59:57.211874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 563/1174] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:57.375561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:57.377234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:57.384294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:57.384920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:57.385410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:57.386213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:57.386675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:57.387156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:57.420027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e51381e5-e88d-4798-a872-f6b62180732f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050064 Sep 06 11:59:57.420608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 612/1175] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:57.885433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:57.887695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:57.895148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:57.895712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:57.896138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:57.897489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:57.897489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:57.897816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:58.082618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5e1af2ab-8dd0-4eb4-b4e1-1930f91d4c24 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201072 Sep 06 11:59:58.083096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 564/1176] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:58.224122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:58.226514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:58.233052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:58.233535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:58.234008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:58.234762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:58.235269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:58.235751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:58.271973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea6b7300-e781-48de-a9da-042b801248b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052022 Sep 06 11:59:58.272617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 613/1177] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:58.432710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:58.434848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:58.442044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:58.442531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:58.442968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:58.443659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:58.444115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:58.444545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:58.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:58.476186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9ab1acc3-7d67-4a02-945f-713dddab758b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Sep 06 11:59:58.476951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 565/1178] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:59.095138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:59.097895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:59.103886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.104377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.104820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.105518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.106008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.106438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.135782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c036c53c-5210-457c-be46-dae9e13366d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Sep 06 11:59:59.136347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 614/1179] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 11:59:59.285064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:59.287252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:59.293445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.293976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.294418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.295111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.295573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.295998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.326159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-243f86e3-4fbf-428e-b640-f4583e2733ec tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045522 Sep 06 11:59:59.326711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 566/1180] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 11:59:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 11:59:59.489422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 11:59:59.491744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 11:59:59.498256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.498744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.499188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.499889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 11:59:59.500345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 11:59:59.500771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 11:59:59.531093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6825be1f-8d19-4512-8001-14c4251ed119 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Sep 06 11:59:59.531650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 615/1181] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 11:59:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:00.150369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:00.152559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:00.160127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:00.160613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:00.161054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:00.161788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:00.162245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:00.162672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:00.192399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3eb931d4-dbf3-410a-b4ab-7132783699ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Sep 06 12:00:00.193269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 567/1182] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:00.338975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:00.341119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:00.347752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:00.348251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:00.348688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:00.349366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:00.349850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:00.350272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:00.380506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2b7a6851-faae-4dea-8f8f-42629bfc5006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045466 Sep 06 12:00:00.381049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 616/1183] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:00.544038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:00.546198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:00.552202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:00.552689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:00.553129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:00.553852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:00.554315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:00.554770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:00.584727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c5110c72-7356-4660-8052-c90133a229c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Sep 06 12:00:00.585282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 568/1184] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:01.205353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:01.207509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:01.214115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:01.214608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:01.215049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:01.215747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:01.216206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:01.216630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:01.247777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b78f6e63-8389-49a5-8c87-23512151547a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Sep 06 12:00:01.248362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 617/1185] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:01.393817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:01.396061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:01.402708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:01.403191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:01.403626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:01.404394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:01.404849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:01.405272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:01.436848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fe74fd07-e630-4ca5-80f2-4e96d092c2d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047294 Sep 06 12:00:01.437437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 569/1186] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:01.598247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:01.600351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:01.607064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:01.607552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:01.608022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:01.608917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:01.609462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:01.610042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:01.640421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-04cf0726-b78d-4d1a-89e0-844fb66631a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Sep 06 12:00:01.641251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 618/1187] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:02.261954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:02.264117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:02.271000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.271436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.271879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.272597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.273115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.273667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.305621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bf1f1235-9009-4319-9c85-216c8522d994 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047821 Sep 06 12:00:02.306195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 570/1188] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:02.450086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:02.452281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:02.459586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.460221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.460750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.461489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.462100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.462532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.493140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b0b6b7e1-68d6-4ad3-a09d-83d75bdd5ccb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047110 Sep 06 12:00:02.493729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 619/1189] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:02.655286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:02.657492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:02.664250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.664725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.665151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.665871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:02.666315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:02.666731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:02.695804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac07229f-01ce-45fb-8153-6ba57e16628e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Sep 06 12:00:02.696375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 571/1190] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:03.318999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:03.329522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:03.329522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:03.329522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:03.329522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:03.333273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:03.333273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:03.333273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:03.365758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-815298e2-cd6b-48a0-939b-1ea09765e99f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049288 Sep 06 12:00:03.365758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 620/1191] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:03.506042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:03.508197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:03.514435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:03.514924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:03.515367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:03.516437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:03.517553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:03.518025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:03.552049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3770d1a0-90a3-46d7-8f52-c15579fb3e61 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050016 Sep 06 12:00:03.553562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 572/1192] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:03.709114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:03.711322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:03.717763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:03.718251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:03.718692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:03.719391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:03.719849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:03.720278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:03.749877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b19b002d-cbc8-497b-a563-f2ce7fb8fbb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Sep 06 12:00:03.750444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 621/1193] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:04.380223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:04.382796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:04.389748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:04.390237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:04.390678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:04.391627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:04.392083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:04.392507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:04.423307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cf00a156-bd15-44d1-beaf-eecdac3b3ec0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Sep 06 12:00:04.423890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 573/1194] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:04.565664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:04.569088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:04.575187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:04.575824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:04.576274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:04.577041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:04.577508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:04.577963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:04.609191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-be78a6ff-ff9d-4519-8ce9-8f87156ded8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047656 Sep 06 12:00:04.615577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 622/1195] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:04.762782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:04.764910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:04.771141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:04.771625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:04.772055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:04.772740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:04.773187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:04.773601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:04.804595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7723bf5-7a82-4c42-b9f7-9c2c07b7f5a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Sep 06 12:00:04.805174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 574/1196] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:05.436080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:05.438339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:05.440720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=90 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:05.446398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.447119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.447582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.448303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.448796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.449227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.453452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:05.483082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-83c28aa3-03ca-44a8-bc45-ae339975254f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050924 Sep 06 12:00:05.483657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 623/1197] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:05.622847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:05.625052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:05.632994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.633547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.634144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.634932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.635392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.635842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.667531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-58aa2302-3026-4fe1-9ff1-82e0b547226f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048818 Sep 06 12:00:05.668090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 575/1198] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:05.816625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:05.819780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:05.825868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.826357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.826876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.827578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:05.828069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:05.828494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:05.859202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-463dabfe-0b41-47e4-a756-1348b18c8943 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046666 Sep 06 12:00:05.859780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 624/1199] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:06.496359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:06.498495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:06.504591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:06.505085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:06.505835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:06.506612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:06.507164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:06.507595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:06.538646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ad89cfaf-0ce8-4ec1-86e8-ab0a53ace9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Sep 06 12:00:06.539205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 576/1200] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:06.680557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:06.683062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:06.689820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:06.690518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:06.690989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:06.691897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:06.692397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:06.692819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:06.723182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0bf5431d-4988-492d-9fca-f2572093c781 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047368 Sep 06 12:00:06.723733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 625/1201] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:06.872231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:06.874385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:06.881052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:06.881283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:06.881750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:06.882432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:06.882878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:06.883297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:06.914242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0d648a8-adaa-4dbb-8909-dc2e0e7b0d66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Sep 06 12:00:06.914812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 577/1202] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:07.551307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:07.554509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:07.560536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:07.561019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:07.561486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:07.562197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:07.562690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:07.563099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:07.593507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-28f2bf4b-b985-4d00-8aef-dd2d11087e9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Sep 06 12:00:07.594148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 626/1203] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:07.736757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:07.738939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:07.745344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:07.745861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:07.746303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:07.746991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:07.747445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:07.747871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:07.777265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc122cad-cdc0-49df-864f-63ee334d62d2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Sep 06 12:00:07.777854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 578/1204] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:07.926750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:07.929725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:07.936380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:07.936872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:07.937633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:07.938039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:07.938497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:07.938922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:07.970590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9580564d-9e43-4ff0-a05b-f1ffc6f18d78 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047884 Sep 06 12:00:07.971161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 627/1205] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:08.605891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:08.608087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:08.614622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:08.615378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:08.615919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:08.616609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:08.617070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:08.617498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:08.650161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-be45abaf-084e-402b-82c6-a6ed9e2a7237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Sep 06 12:00:08.650737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 579/1206] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:08.789826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:08.792104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:08.798189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:08.798677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:08.799122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:08.799813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:08.800276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:08.800708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:08.830449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f7aaa0f1-5824-4c13-a4db-45ab84cd8796 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044927 Sep 06 12:00:08.831024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 628/1207] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:08.983754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:08.985965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:08.992528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:08.993014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:08.993455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:08.994181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:08.994640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:08.995069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:09.024648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f5244cd-0d65-4be0-bace-b745d96ad107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Sep 06 12:00:09.025208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 580/1208] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:09.663397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:09.665528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:09.672018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:09.672496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:09.672927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:09.673612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:09.674081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:09.674503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:09.704135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8989d74f-f733-4775-86bf-a00f50cdc2f6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Sep 06 12:00:09.704697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 629/1209] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:09.843761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:09.845871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:09.852491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:09.852977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:09.853419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:09.854149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:09.854609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:09.855040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:09.884375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81d44f08-1ab3-4322-b2df-6d47abacf280 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044610 Sep 06 12:00:09.884942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 581/1210] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:10.037903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:10.040103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:10.046133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:10.046616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:10.047050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:10.047743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:10.048221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:10.048640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:10.077891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9d571e3-d1e0-4f35-8e1a-515511337b03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Sep 06 12:00:10.078457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 630/1211] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:10.717365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:10.719541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:10.726101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:10.726588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:10.727028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:10.727727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:10.728182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:10.728610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:10.746966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:10.760151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35540c0a-ff0e-4c84-a4ae-817aa16b4a06 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046786 Sep 06 12:00:10.760714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 582/1212] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:10.897389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:10.899591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:10.906067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:10.906552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:10.907015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:10.907705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:10.908161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:10.908587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:10.939229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b781ee01-918f-4149-b8ad-d18ebd0e18d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045858 Sep 06 12:00:10.939809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 631/1213] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:11.090579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:11.092636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:11.098623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:11.099614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:11.100082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:11.100774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:11.101229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:11.101690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:11.134949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-13ad8792-35c1-41fc-9ca7-cbd77c953b85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048390 Sep 06 12:00:11.135516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 583/1214] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:11.773249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:11.775515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:11.781407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:11.782038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:11.782485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:11.783169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:11.783618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:11.784035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:11.813035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3dae0d88-e17e-4c90-bb83-d32c2d4f569c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Sep 06 12:00:11.813594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 632/1215] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:11.952595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:11.954758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:11.957031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=88 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:11.962498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:11.962982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:11.963421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:11.964113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:11.964568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:11.964993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:11.994740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0828cd2f-db35-4291-a707-e207ca57b8b9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046154 Sep 06 12:00:11.995293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 584/1216] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:12.148098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:12.150329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:12.156780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:12.157271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:12.157750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:12.158447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:12.158907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:12.159333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:12.189266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efbe9252-5038-44e6-9f15-0df3fc65ab4a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Sep 06 12:00:12.189849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 633/1217] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:12.825546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:12.827746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:12.833741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:12.834757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:12.835195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:12.835886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:12.836339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:12.836762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:12.866522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d0556492-192f-4993-b40a-24d0bbc67ca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Sep 06 12:00:12.867077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 585/1218] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:13.007760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:13.009958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:13.016000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:13.016739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:13.017180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:13.017910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:13.018370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:13.018798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:13.048571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-873917d4-2ffb-430d-a1de-b5e8f152c7e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045809 Sep 06 12:00:13.049133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 634/1219] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:13.201496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:13.203695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:13.210092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:13.210572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:13.211005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:13.211684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:13.212134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:13.212553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:13.242195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f4d8e09-aacc-48d9-8764-8f8ea84918f9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Sep 06 12:00:13.242750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 586/1220] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:13.879014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:13.881271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:13.887862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:13.888339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:13.888774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:13.889465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:13.889945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:13.890369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:13.919973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d0094c82-db54-4468-b16b-55e3ffe3c8c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Sep 06 12:00:13.920536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 635/1221] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:14.062120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:14.064281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:14.070332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:14.070820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:14.071261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:14.071953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:14.072416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:14.072844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:14.104289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a72108c9-1750-4202-bae9-31278cf99a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Sep 06 12:00:14.104846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 587/1222] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:14.254202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:14.256417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:14.262430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:14.262910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:14.263344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:14.264035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:14.264477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:14.264899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:14.294922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-52b170a8-e66b-46b3-85f6-7aaaf6f9bfbc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 06 12:00:14.295473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 636/1223] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:14.933041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:14.935946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:14.942408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:14.942894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:14.944515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:14.945222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:14.945705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:14.946133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:14.975691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-14e567aa-15d8-4cb6-b2bf-c6fcbf047462 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046615 Sep 06 12:00:14.976254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 588/1224] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:15.118146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:15.120696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:15.127499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:15.127980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:15.128411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:15.129104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:15.129552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:15.129994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:15.163919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6dff8d71-06d8-4903-a7a3-87ea34ce5c06 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050720 Sep 06 12:00:15.164509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 637/1225] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:15.309091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:15.311223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:15.317288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:15.317817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:15.318343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:15.319724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:15.320250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:15.320856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:15.352468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31b660a6-51d3-46e0-9ded-8fb7f213d3fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Sep 06 12:00:15.353071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 589/1226] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:15.988506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:15.991047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:15.997220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:15.997753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:15.998258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:15.998910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:15.999366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:15.999806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:16.032137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9851f326-403d-4559-933f-8af87015ed85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Sep 06 12:00:16.032714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 638/1227] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:16.176693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:16.179567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:16.186096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:16.186577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:16.187011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:16.187705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:16.188185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:16.188615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:16.219558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-80b9d34c-597b-45b7-a315-388e6f8a486e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046856 Sep 06 12:00:16.220128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 590/1228] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:16.364675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:16.367636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:16.374176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:16.374659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:16.375099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:16.375792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:16.376279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:16.376721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:16.404724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:16.410900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9a1a2676-c7c8-4d3c-807e-354ba1fc7ae4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050203 Sep 06 12:00:16.411707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 639/1229] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:17.044504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:17.046682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:17.052800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:17.053292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:17.053764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:17.054463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:17.054920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:17.055348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:17.086197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4130bada-90b4-482b-a21c-328bc65990b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Sep 06 12:00:17.086758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 591/1230] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:17.232651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:17.235290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:17.242121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:17.242925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:17.243408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:17.244133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:17.244596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:17.245166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:17.280902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fee80718-c7b4-4f27-bd56-0b09df3cb51e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052350 Sep 06 12:00:17.281632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 640/1231] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:17.424802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:17.427022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:17.434070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:17.434557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:17.434998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:17.435695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:17.436152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:17.436572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:17.465697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0087e2fc-1dc2-4cc3-a97b-9d24281627e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Sep 06 12:00:17.466263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 592/1232] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:18.098790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:18.102091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:18.108570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:18.109054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:18.109493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:18.110216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:18.110667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:18.111089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:18.140838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f691cf54-44ac-487e-a852-dac1ee05e655 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Sep 06 12:00:18.141666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 641/1233] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:18.294736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:18.296922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:18.303106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:18.303582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:18.304012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:18.304696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:18.305142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:18.305560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:18.336437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-85e3f360-cd28-4b88-bc6c-47fb8235d377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044930 Sep 06 12:00:18.336437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 593/1234] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:18.478447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:18.480580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:18.486601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:18.487079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:18.487508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:18.488194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:18.488641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:18.489061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:18.519788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-097196c9-e283-4904-860d-58737c2208a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Sep 06 12:00:18.520315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 642/1235] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:19.155190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:19.158081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:19.165585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:19.166126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:19.166630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:19.167484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:19.167960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:19.168380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:19.202725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a72012ea-9d17-425d-a2f1-751310d5a917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052801 Sep 06 12:00:19.203306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 594/1236] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:19.348698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:19.352081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:19.358858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:19.359364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:19.359779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:19.360545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:19.361120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:19.361548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:19.394988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-51a01eae-985a-4b5e-8af3-f1da969c716d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050165 Sep 06 12:00:19.395459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 643/1237] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:19.533663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:19.535724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:19.542817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:19.543320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:19.543724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:19.544462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:19.544911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:19.545329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:19.574863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a34b14b-f585-47d4-ba24-e55d38efe749 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045303 Sep 06 12:00:19.575425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 595/1238] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:20.217069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:20.219589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:20.226682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:20.227168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:20.227647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:20.228406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:20.228886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:20.229434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:20.262890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4b7a5e50-1080-4feb-9230-a3f33a0d885a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050233 Sep 06 12:00:20.263716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 644/1239] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:20.409498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:20.412035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:20.420272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:20.420817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:20.421282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:20.421997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:20.422450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:20.422874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:20.453897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ccbd95b-cd07-4ce1-b530-740cf1c921bb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049367 Sep 06 12:00:20.454454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 596/1240] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:20.588379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:20.590641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:20.597717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:20.598230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:20.598683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:20.599479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:20.599995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:20.600731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:20.632216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f23cae6-d896-4834-9618-70716caa92f5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048381 Sep 06 12:00:20.632839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 645/1241] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:21.276533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:21.278734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:21.284865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:21.285335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:21.285816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:21.286508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:21.286962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:21.287386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:21.317941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e37a612e-4300-4fb4-b204-89eebddd2baa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Sep 06 12:00:21.318511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 597/1242] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:21.466884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:21.469033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:21.475132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:21.476743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:21.477186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:21.477916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:21.478373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:21.478798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:21.509390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d2016f46-6839-4c54-bb13-9b95c801a109 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046503 Sep 06 12:00:21.509993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 646/1243] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:21.645141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:21.647873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:21.655001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:21.655477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:21.655906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:21.656586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:21.657029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:21.657455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:21.687194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c40f43e0-59dd-4094-bfb1-0cffbf28dd69 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Sep 06 12:00:21.687748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 598/1244] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:22.330753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:22.333112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:22.340318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:22.340809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:22.341253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:22.342684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:22.343142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:22.343572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:22.379320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8f2522a3-4bc0-43bd-a01a-e11b6483add6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052481 Sep 06 12:00:22.379884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 647/1245] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:22.523332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:22.525602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:22.532284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:22.532774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:22.533211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:22.533956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:22.534405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:22.534824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:22.539543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:22.565543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ec2b0457-181f-4ef5-8dac-be4ca85a8a20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046811 Sep 06 12:00:22.566139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 599/1246] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:22.700077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:22.702298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:22.708228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:22.708718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:22.709161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:22.709885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:22.710890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:22.711396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:22.740994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-356193ff-e5d5-4b0d-8d0e-375686cbd0a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Sep 06 12:00:22.741561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 648/1247] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:23.392828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:23.395071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:23.401745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:23.402231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:23.402672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:23.403372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:23.403830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:23.404349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:23.436410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a36c674-e19e-4c55-8ab6-b685e583eabb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047789 Sep 06 12:00:23.436987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 600/1248] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:23.578831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:23.581546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:23.588534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:23.589114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:23.589676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:23.590457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:23.590990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:23.591491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:23.622030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73e63df7-2b7f-4576-8444-6a2c957b828f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047446 Sep 06 12:00:23.622597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 649/1249] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:23.752877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:23.755121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:23.761574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:23.762096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:23.762540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:23.763245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:23.763706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:23.764132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:23.794798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7246482d-e391-46fa-acf7-3a62edcbf5c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Sep 06 12:00:23.795574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 601/1250] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:24.448896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:24.451080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:24.457160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:24.457665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:24.458118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:24.458819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:24.459276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:24.459711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:24.489952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee35b63e-ee95-4f90-aa47-91d30d99a420 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Sep 06 12:00:24.490725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 650/1251] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:24.635137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:24.637281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:24.644131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:24.644611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:24.645043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:24.645756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:24.646210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:24.646627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:24.678612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c5028ae-b9de-4940-b6dc-b88787630b69 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047595 Sep 06 12:00:24.679223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 602/1252] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:24.810745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:24.813752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:24.820398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:24.820741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:24.821385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:24.822119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:24.822575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:24.823003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:24.855189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfa286a8-d149-4d78-8c74-68464c1b6b71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Sep 06 12:00:24.855973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 651/1253] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:25.502513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:25.504705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:25.511390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:25.511870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:25.512316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:25.513007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:25.513458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:25.513923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:25.543931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31755a33-50a3-40b5-adc0-1912d2e186d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Sep 06 12:00:25.544486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 603/1254] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:25.690987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:25.693143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:25.700069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:25.700560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:25.701003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:25.701736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:25.702197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:25.702623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:25.733092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-53f12fb6-e457-46da-b91e-198b9a034f02 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Sep 06 12:00:25.733690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 652/1255] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:25.868522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:25.871056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:25.877491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:25.878024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:25.878467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:25.879160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:25.879614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:25.880039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:25.910894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1aaaae97-710a-4137-9a08-4964a6c1bd77 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Sep 06 12:00:25.911456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 604/1256] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:26.556963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:26.559180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:26.565494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:26.566074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:26.566472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:26.567162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:26.567617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:26.568041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:26.599338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6ca1f10e-26f8-481f-910f-5e0ea8fbbee8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Sep 06 12:00:26.599910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 653/1257] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:26.746064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:26.748133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:26.754161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:26.754647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:26.755079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:26.755771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:26.756221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:26.756642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:26.786412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ffd4476-f1ab-4412-9a7a-0b8fed4a1367 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044441 Sep 06 12:00:26.786967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 605/1258] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:26.923749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:26.925945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:26.932198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:26.932675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:26.933103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:26.933821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:26.934270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:26.934688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:26.964907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-11d097d6-479a-4a0b-8d54-7426c0b67250 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 06 12:00:26.965459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 654/1259] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:27.612836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:27.615091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:27.622423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:27.622914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:27.623355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:27.624057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:27.624724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:27.624946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:27.659138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f20b7f0a-7551-46f1-97e1-7bca9772615c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050572 Sep 06 12:00:27.659699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 606/1260] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:27.800184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:27.802348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:27.810123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:27.810701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:27.811151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:27.811850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:27.812306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:27.812734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:27.843593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d5c3b829-eb06-4471-890c-3f1bfef43250 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047670 Sep 06 12:00:27.844164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 655/1261] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:27.978210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:27.980361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:27.986511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:27.987015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:27.987468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:27.988234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:27.988725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:27.989153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:28.019169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ea58b652-9e62-4399-a72a-84cec7437f3e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Sep 06 12:00:28.019747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 607/1262] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:28.672791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:28.675147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:28.682261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:28.682749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:28.683210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:28.684097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:28.684581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:28.685036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:28.703363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:28.716700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dd3ef62f-3a97-4bec-a375-ab317b014782 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 Sep 06 12:00:28.717287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 656/1263] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:28.858462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:28.861193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:28.869245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:28.869769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:28.870251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:28.870950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:28.871398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:28.871814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:28.901873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c4cb939e-7d77-4fea-8686-3b1e337a7fba tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047776 Sep 06 12:00:28.902430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 608/1264] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:29.032585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:29.034811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:29.042213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:29.042699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:29.043141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:29.043837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:29.044294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:29.044721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:29.074415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d74c1be5-0cfb-44c8-a352-ff9edc417b7a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Sep 06 12:00:29.074985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 657/1265] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:29.729222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:29.731430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:29.737356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:29.737893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:29.738337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:29.739028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:29.739484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:29.739913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:29.769797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ce78ac1-17c2-42e4-8940-dd70e39dcec3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Sep 06 12:00:29.770351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 609/1266] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:29.916004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:29.918389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:29.924441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:29.924929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:29.925370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:29.926096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:29.926591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:29.927019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:29.957463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e97adac4-8d1e-4c3e-a240-28f84ba9c283 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046431 Sep 06 12:00:29.958065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 658/1267] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:30.086931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:30.089093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:30.095431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:30.095906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:30.096336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:30.097014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:30.097463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:30.097904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:30.127166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-45685844-59ef-4cd8-83e9-31e3fd77289b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Sep 06 12:00:30.127711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 610/1268] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:30.782330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:30.784485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:30.792706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:30.793195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:30.793718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:30.794628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:30.795152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:30.795633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:30.828245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-581f210d-b113-4324-8341-c09b561872db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049797 Sep 06 12:00:30.828821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 659/1269] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:31.122327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:31.124617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:31.130600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:31.131088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:31.131531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:31.132921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:31.133347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:31.133805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:31.141189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:31.143800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:31.146144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:00:31.146358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:00:31.147533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:00:31.147711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:00:31.156678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:31.157167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:31.157605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:31.158339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:31.158797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:31.159225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:31.165789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d09257d9-eb8e-48fe-90ad-3d3acae10f47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198841 Sep 06 12:00:31.170436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 611/1270] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:31.192130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4870b03c-e667-47b8-9e5b-fe2c7daa9c92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055893 Sep 06 12:00:31.192711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 660/1271] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:31.841112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:31.843391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:31.849779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:31.850255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:31.850718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:31.851988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:31.852436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:31.852853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:31.885174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b32b5b9-3311-4f70-846d-c7338f6f4970 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Sep 06 12:00:31.885767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 612/1272] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:32.179033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:32.181707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:32.189319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:32.189844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:32.190286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:32.190993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:32.191448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:32.191874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:32.206572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:32.208907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:32.215935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:32.216538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:32.217045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:32.217879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:32.218409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:32.218912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:32.227876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-96006555-fe48-446e-8a3e-90e125cea8c7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054268 Sep 06 12:00:32.228459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 661/1273] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:32.249352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35338fbe-66ad-4701-b3fe-7f6edd08d8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047576 Sep 06 12:00:32.250048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 613/1274] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:32.897750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:32.901095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:32.907124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:32.907619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:32.908055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:32.908743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:32.909191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:32.909609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:32.939968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7913cada-7711-491a-8a3b-0be5d2374065 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046126 Sep 06 12:00:32.940532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 662/1275] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:33.240533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:33.243177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:33.249807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:33.250397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:33.250819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:33.251512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:33.251943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:33.252361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:33.262221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:33.264371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:33.271105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:33.271586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:33.272016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:33.272706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:33.273793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:33.274211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:33.286387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15bc62b4-6c2a-4f48-a077-1daac1a0f49d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049772 Sep 06 12:00:33.288649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 614/1276] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:33.305201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-05d7ea16-d3b6-40f4-9e12-dcfa1071972a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Sep 06 12:00:33.305784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 663/1277] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:34.037388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:34.040282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:34.046170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:34.046652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:34.047086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:34.047774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:34.048226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:34.048648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:34.075598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:34.081225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aef0b2d9-54cf-4fa4-8819-02f983395a50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132764 Sep 06 12:00:34.082039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 615/1278] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:34.299462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:34.301667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:34.309057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:34.309545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:34.310019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:34.310716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:34.311202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:34.311634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:34.317435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:34.320332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:34.327223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:34.327707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:34.328143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:34.328834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:34.329282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:34.329729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:34.342109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9145553-0314-4001-9aba-3058c07afab5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046682 Sep 06 12:00:34.342690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 664/1279] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:34.359734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-894c559a-d069-4eb4-b4d3-c4fbdf1adcdb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Sep 06 12:00:34.360288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 616/1280] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:35.094372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:35.096549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:35.103341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:35.103824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:35.104260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:35.104951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:35.105405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:35.105864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:35.135123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f105ea50-c016-4884-a08b-c7d756c435d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 06 12:00:35.135678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 665/1281] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:35.355051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:35.357306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:35.359328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:00:35.359500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:00:35.366319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:35.366839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:35.367279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:35.368071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:35.368528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:35.368952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:35.373087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:35.375667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:35.382721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:35.383213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:35.383683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:35.384429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:35.384887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:35.385314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:35.404002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-059a762a-aeec-4a11-8886-2ab3a977c46f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053071 Sep 06 12:00:35.404580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 617/1282] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:35.420957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3724376-32f0-4b92-81f2-28a7a6bad1f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051695 Sep 06 12:00:35.421434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 666/1283] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:36.147794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:36.150008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:36.155989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:36.156474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:36.156918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:36.157605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:36.158087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:36.158512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:36.188187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1fd788e7-a56d-4db6-a827-fc475309cef5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Sep 06 12:00:36.188739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 618/1284] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:36.417579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:36.420693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:36.425025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=88 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:36.429511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:36.430068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:36.430480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:36.431185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:36.431641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:36.432067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:36.433794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:36.435981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:36.442302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:36.442784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:36.443218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:36.443911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:36.444361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:36.444783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:36.463352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-818dd8b8-64c7-4eda-995e-08dfc2a1d6b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050702 Sep 06 12:00:36.463926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 667/1285] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:36.475589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aa9100b1-cd42-4174-9cc1-aaa1d4daf842 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Sep 06 12:00:36.477197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 619/1286] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:37.201475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:37.203723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:37.209788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:37.210337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:37.210803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:37.211515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:37.211976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:37.212402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:37.241412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cb4c6900-80e9-4677-80dd-2f4f4c5b1654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Sep 06 12:00:37.242615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 668/1287] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:37.476775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:37.478988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:37.485450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:37.485964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:37.486403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:37.487105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:37.487555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:37.487981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:37.488616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:37.490829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:37.498560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:37.499043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:37.499482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:37.500185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:37.500640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:37.501064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:37.519839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b93845b-120e-4d51-976a-512c421fff2a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047599 Sep 06 12:00:37.520430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 620/1288] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:37.543424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f3f50824-f690-46df-bea6-380987ea5393 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058685 Sep 06 12:00:37.544001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 669/1289] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:38.261172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:38.263593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:38.269949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:38.270350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:38.270785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:38.271483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:38.271923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:38.272347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:38.315731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1bfdaf8-7f9f-44b3-a732-11891a89f28b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060791 Sep 06 12:00:38.316292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 621/1290] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:38.532970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:38.535228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:38.541922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:38.542411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:38.542848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:38.543547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:38.544005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:38.544430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:38.556359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:38.558606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:38.565381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:38.565925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:38.566374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:38.567093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:38.567545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:38.567976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:38.578226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41c7ef30-6527-4fa6-8d42-1e66884c862f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049229 Sep 06 12:00:38.578828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 670/1291] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:38.599797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-93ab9e53-6f17-4a82-8531-4922ee6fc8eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048047 Sep 06 12:00:38.600370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 622/1292] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:39.328077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:39.330312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:39.336212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:39.337282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:39.337282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:39.338347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:39.338803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:39.339231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:39.370202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-342435a0-f031-429f-ad06-cb530ec2e4b4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Sep 06 12:00:39.370784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 671/1293] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:39.591603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:39.593865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:39.599760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:39.600246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:39.600678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:39.601356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:39.601829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:39.602252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:39.613416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:39.615608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:39.622151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:39.622750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:39.623084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:39.623782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:39.624240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:39.624666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:39.633458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a6cd071-b643-4dfb-b6c9-aee22df51bbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046402 Sep 06 12:00:39.634718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 623/1294] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:00:39.658405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9ac9e85-d3ea-4837-970f-d4ad1cb748fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049103 Sep 06 12:00:39.658964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 672/1295] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:40.382619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:40.385375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:40.391579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:40.392306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:40.392738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:40.393427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:40.393901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:40.394320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:40.424719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9bbbcb60-a6b0-4d25-b77b-d890396ed4b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Sep 06 12:00:40.425426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 624/1296] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:40.647073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:40.649158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:40.655593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:40.656084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:40.656525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:40.657222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:40.657707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:40.658139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:40.661803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:40.671445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:40.673706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:40.680257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:40.681472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:40.681903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:40.682599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:40.683041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:40.683459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:40.688933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4bf6e54b-9fde-4ff1-8c7d-e69cea44de4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045885 Sep 06 12:00:40.689508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 673/1297] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:40.712204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e19fd904-3598-49aa-a175-4458162e16bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 06 12:00:40.712900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 625/1298] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:41.436499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:41.438701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:41.444645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:41.445126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:41.445555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:41.446945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:41.447360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:41.447783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:41.478694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-67d57671-c541-4a92-9a48-40b823a5bb58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 Sep 06 12:00:41.480027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 674/1299] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:41.702443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:41.704532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:41.710850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:41.711328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:41.711777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:41.712467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:41.712911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:41.713328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:41.724320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:41.726505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:41.732730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:41.733336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:41.733695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:41.734363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:41.734811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:41.735232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:41.744695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1e3b0dc-117e-4599-819c-ac3ec27d9d45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046247 Sep 06 12:00:41.745262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 626/1300] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:41.767217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ba695bdf-7a66-48c3-83f8-8ec4a3b9323b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Sep 06 12:00:41.767781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 675/1301] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:42.490731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:42.492891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:42.495413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=86 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:42.500917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:42.501739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:42.502354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:42.503058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:42.503512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:42.503941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:42.541309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7441fc9e-e47a-4ce2-9635-40f6323be46b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054752 Sep 06 12:00:42.542141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 627/1302] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:42.758892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:42.761150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:42.767355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:42.767835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:42.768266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:42.768948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:42.769394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:42.769848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:42.780319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:42.782718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:42.789013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:42.789506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:42.789986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:42.791448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:42.792034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:42.792474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:42.800600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2128ca20-4c96-4b9b-8075-c7c0326f1937 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047159 Sep 06 12:00:42.801183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 676/1303] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:00:42.823041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-354705da-0ca8-4a0d-bb8c-000d31506857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Sep 06 12:00:42.823610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 628/1304] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:43.554027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:43.557597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:43.562496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:43.562985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:43.563426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:43.564135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:43.564595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:43.565025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:43.596404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-360caa88-4e83-4d51-9045-44eebbe79a1d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046338 Sep 06 12:00:43.601166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 677/1305] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:43.813491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:43.815652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:43.822788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:43.823272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:43.823704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:43.824408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:43.824860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:43.825287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:43.835237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:43.837456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:43.843943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:43.844450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:43.844873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:43.845578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:43.846135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:43.846566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:43.855866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-36dfb528-b50e-463d-9084-a2172a6a9d55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046469 Sep 06 12:00:43.856438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 629/1306] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:43.876525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3958ccab-68c0-4979-b4e0-1988f9cd54e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Sep 06 12:00:43.877090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 678/1307] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:44.609478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:44.611704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:44.617912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:44.618404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:44.619445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:44.620154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:44.620611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:44.621042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:44.652138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-96863ab3-5b61-4dee-9d14-32eeacb491b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Sep 06 12:00:44.652713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 630/1308] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:44.871332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:44.873442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:44.880022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:44.880510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:44.880948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:44.881665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:44.882136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:44.882562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:44.890768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:44.893264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:44.899826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:44.900574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:44.901115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:44.901844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:44.902298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:44.902717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:44.913453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0b08b07a-902a-4c0f-9c5e-9e9358c30239 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047189 Sep 06 12:00:44.914071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 679/1309] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:44.934092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ad1ed084-6014-4b1b-80d4-c59e1158aa75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047184 Sep 06 12:00:44.934654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 631/1310] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:45.664826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:45.667024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:45.673498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:45.673619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:45.674092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:45.674791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:45.675361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:45.675794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:45.707360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e8a1a50-7755-4e4f-841a-1b6813ed9e92 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Sep 06 12:00:45.707936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 680/1311] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:45.927195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:45.929274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:45.936323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:45.936838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:45.937275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:45.937983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:45.938435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:45.938854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:45.946366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:45.949281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:45.955783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:45.956272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:45.956711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:45.957409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:45.957895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:45.958041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:45.958328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:45.971995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-29806ec9-680f-4eac-abe2-5c4836d5f3b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048932 Sep 06 12:00:45.972571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 632/1312] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:45.988740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed84b3d7-4928-4600-9217-46fbabbcc14f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Sep 06 12:00:45.989308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 681/1313] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:46.720202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:46.722441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:46.728506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:46.728981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:46.729498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:46.730225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:46.730678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:46.731104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:46.762744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-42d51ef3-1d75-42af-bb8b-bf4445c22ad3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Sep 06 12:00:46.763333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 633/1314] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:46.984747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:46.986880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:46.993311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:46.994401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:46.994881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:46.995593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:46.996072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:46.996483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.001165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:47.003383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:47.010653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.011141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.011578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.012275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.012721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.013133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.028699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6213166-ccfe-4376-9aae-75db695b930a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047993 Sep 06 12:00:47.029282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 682/1315] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:47.042870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d0c4d6ea-eb16-4ee2-b4cb-1852269186f0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045517 Sep 06 12:00:47.043432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 634/1316] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:47.482001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:47.482488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:47.488436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.488911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.489343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.490046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.490503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.490923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.648204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'services' on Instance uuid e8593b18-2abc-4a13-9c4a-3515edd30fd0 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:00:47.719080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f015f60-ca63-4e31-8d89-d47872b9ab4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments/0fd8d628-e705-477b-b3fa-399ef5fe20ec" status: 202 len: 0 microversion: 2.1 time: 0.241552 Sep 06 12:00:47.719670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 683/1317] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 12:00:47 2022] DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments/0fd8d628-e705-477b-b3fa-399ef5fe20ec => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:00:47.728758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:47.731027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:47.737226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.737748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.738196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.738902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.739677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.740239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.776367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-033724ac-9b52-40a3-8a3d-e5f8ba7a2668 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051629 Sep 06 12:00:47.776817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:47.777799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 635/1318] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:47.779438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:47.785768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.786259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.786697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.787408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:47.787855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:47.788307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:47.821289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0a56b65b-e125-4437-976e-64944fb712c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049517 Sep 06 12:00:47.822896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 684/1319] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:48.042308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:48.044360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:48.051087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.051663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.052140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.052844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.053333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.053788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.054313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:48.056730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:48.063145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.063638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.064072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.064770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.065224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.065726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.084382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b2e9cd8e-b885-4a19-85cc-0859d93b2892 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047052 Sep 06 12:00:48.084949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 636/1320] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:48.097765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1204d73c-b7c5-463a-ad37-1bbefa63a6e3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Sep 06 12:00:48.098329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 685/1321] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:48.789600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:48.792654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:48.798772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.799266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.799708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.800400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.800860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.801291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.831255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ce4c63f2-9553-4845-addc-6304836087e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Sep 06 12:00:48.831818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 637/1322] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:48.834849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:48.836999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:48.843577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.844066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.844502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.845189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:48.845666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:48.846122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:48.878355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0de77f41-19ad-4652-8f8b-15d91bcd74ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047457 Sep 06 12:00:48.878932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 686/1323] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:49.098570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:49.100612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:49.108194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.108672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.109102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.109830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.110276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.110695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.115591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:49.117843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:49.124701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.125198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.125637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.126380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.126843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.127274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.141328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2be1aa06-6270-45b2-bb9e-672859b8e391 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046852 Sep 06 12:00:49.145626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 638/1324] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:49.158807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc464c72-8c0d-4067-8f32-d4a1f570c05f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051474 Sep 06 12:00:49.159395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 687/1325] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:49.844571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:49.846767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:49.853582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.854186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.854604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.855303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.855767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.856198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.885800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4995aff1-ad6d-45bc-ad13-dbed9098fe1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 06 12:00:49.886373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 639/1326] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:49.890892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:49.893344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:49.899625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.900858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.901058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.901778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:49.902236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:49.902663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:49.934242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3918642-909e-49ef-a34e-e2ee0cd8f910 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Sep 06 12:00:49.934832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 688/1327] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:50.155145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:50.157246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:50.163632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.164114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.164550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.165246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.165721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.166157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.171613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:50.173858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:50.180312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.180796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.181347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.182571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.183030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.183493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.188096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:50.196215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2d0dd1a2-b640-4c0f-86eb-c04009db8760 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045115 Sep 06 12:00:50.197291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 640/1328] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:50.216923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-05409734-64bd-4e69-bfa8-ebafbab1b9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049230 Sep 06 12:00:50.217491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 689/1329] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:50.898706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:50.901326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:50.907349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.907829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.908261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.908945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.909404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.909857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.941288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a557293-ad41-4d07-b5c5-74775c9451ff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Sep 06 12:00:50.942048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 641/1330] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:50.948475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:50.950945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:50.959213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.959714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.960158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.960865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:50.961323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:50.961786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:50.996086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-566248ab-3e36-4cad-baab-585c3bc24f78 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051960 Sep 06 12:00:50.996682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 690/1331] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:51.209541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:51.211723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:51.218410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:51.218897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:51.219335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:51.220025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:51.220478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:51.220906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:51.229421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:51.231720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:51.238346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:51.238830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:51.239275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:51.239971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:51.240423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:51.240844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:51.252238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9bdb844-8304-457e-8c83-50c76e0648f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046646 Sep 06 12:00:51.252828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 642/1332] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:51.274064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a1d30441-103e-4b25-b831-75e935c3cfe0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049613 Sep 06 12:00:51.274648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 691/1333] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:51.953634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:51.955850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:51.961888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:51.963063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:51.963695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:51.964385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:51.964834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:51.965253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:51.994368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f0f30ea-0f4c-42dd-9452-fa4368dc1356 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Sep 06 12:00:51.994966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 643/1334] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:52.008384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:52.011261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:52.017515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:52.018043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:52.018483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:52.019180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:52.019643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:52.020111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:52.049702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ac112948-aa99-47e9-b678-cceeca0f8ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Sep 06 12:00:52.050506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 692/1335] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:52.265369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:52.267796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:52.274345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:52.275373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:52.275813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:52.276514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:52.276969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:52.277389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:52.287252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:52.289408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:52.296363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:52.296844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:52.297280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:52.298016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:52.298478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:52.298899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:52.308402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0039f9cf-4f02-43d3-b35e-f8fcba66dd81 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047045 Sep 06 12:00:52.309166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 644/1336] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:00:52.328465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e478a987-258b-430a-a8d7-b467b6d22240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Sep 06 12:00:52.329028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 693/1337] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:53.006970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:53.009145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:53.015090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.015570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.016016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.016706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.017418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.017876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.048799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f8d6a28-291a-4def-82ea-abf39dc27852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Sep 06 12:00:53.049371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 645/1338] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:53.062209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:53.064347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:53.070275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.070761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.071194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.072018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.072468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.072888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.103663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c4ea592e-7867-45e0-b1bb-d2599ff9285d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Sep 06 12:00:53.104206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 694/1339] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:53.321379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:53.324529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:53.330993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.331472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.331908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.332645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.333100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.333520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.341025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:53.343594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:53.350098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.350615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.351057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.351763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:53.352337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:53.352772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:53.366103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f5ffd335-df76-4fca-822a-39109540bb8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048908 Sep 06 12:00:53.366684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 646/1340] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:53.382433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d6aaa1ff-1567-44e2-831e-1c3f95ea7390 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045945 Sep 06 12:00:53.382989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 695/1341] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:54.062406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:54.064575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:54.070565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.071046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.071490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.072186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.072633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.073050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.106183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e08d71bc-205d-457b-ae7f-fb6521365b76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047718 Sep 06 12:00:54.106765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 647/1342] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:54.116027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:54.118217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:54.125099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.125590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.126062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.126758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.127233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.127643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.156928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfb08353-289f-49f5-856b-de6f02159e1b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Sep 06 12:00:54.157503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 696/1343] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:54.378616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:54.380663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:54.387159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.387642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.388069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.388747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.389193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.389728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.394910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:54.397379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:54.404781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.405273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.405746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.406455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:54.406915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:54.407341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:54.420854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-446527b4-e380-4de1-8fe1-9b8fa924914d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046264 Sep 06 12:00:54.421413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 648/1344] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:54.438060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e43359ab-f1ab-4d43-bc8c-904d411cd1c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Sep 06 12:00:54.438625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 697/1345] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:55.119307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:55.121474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:55.127779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.128260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.128701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.129393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.129883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.130314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.133937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:55.161082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-61e95f66-d96f-41dd-ab74-ca27056478e4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Sep 06 12:00:55.161696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 649/1346] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:55.170295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:55.172469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:55.179083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.179571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.180016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.180709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.182268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.182709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.214019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a84f5757-537a-4ca1-a89b-bbae96a07271 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Sep 06 12:00:55.214590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 698/1347] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:55.434007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:55.436166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:55.443208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.443690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.444130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.444935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.445547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.446012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.451113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:55.453343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:55.459774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.460259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.460698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.461400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:55.461899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:55.462422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:55.475733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e8957b26-fc51-41c8-b248-f17c156d0ff8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046588 Sep 06 12:00:55.476303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 650/1348] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:55.492745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b6c929ee-7191-4e23-9909-3287d634ce32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045939 Sep 06 12:00:55.493308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 699/1349] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:56.173724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:56.175913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:56.181934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.182425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.182866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.183566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.184019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.184441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.214831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1aa10c8a-c621-43f7-9e13-d1960aabca19 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Sep 06 12:00:56.215396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 651/1350] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:56.226419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:56.228613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:56.234836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.235313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.235776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.236454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.236901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.237317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.267815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9c0be478-1887-43a5-b2ef-0654c14dd533 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Sep 06 12:00:56.268592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 700/1351] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:56.490714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:56.492860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:56.500136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.500723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.501187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.502213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.502699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.503129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.505893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:56.508235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:56.515376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.515862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.516300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.517000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:56.517768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:56.518193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:56.533839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1f951975-dbd7-4c4a-a8a9-395ad68b820c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047088 Sep 06 12:00:56.534419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 652/1352] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:56.548310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4ba3e33-2355-4913-adea-6bb2dee6087d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046847 Sep 06 12:00:56.548874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 701/1353] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:57.227521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:57.230328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:57.236357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.236853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.237294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.238020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.238478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.238906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.270937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-55e25a83-a12a-437e-8273-7dc0f11e2fd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047382 Sep 06 12:00:57.271505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 653/1354] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:57.280573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:57.282955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:57.289476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.289990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.290416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.291169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.291825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.292398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.323772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d4609947-e64f-44c2-a076-92efd07dd9ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047259 Sep 06 12:00:57.324346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 702/1355] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:57.547007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:57.549061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:57.555073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.555577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.555993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.556721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.557154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.557565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.560998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:57.563228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:57.569687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.570180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.570621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.571319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:57.571778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:57.572207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:57.587922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5a19af6e-bb9d-4377-8628-ca74d0fa99bc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045998 Sep 06 12:00:57.589302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 654/1356] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:57.602522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-176d73a9-baff-4cc9-803e-2f8fff6d11eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Sep 06 12:00:57.603088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 703/1357] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:58.283744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:58.285906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:58.292302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.292794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.293240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.293969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.294433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.294861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.325428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c96f0cdb-686d-4e01-a3b4-ad5dbf813746 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Sep 06 12:00:58.326024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 655/1358] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:58.336256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:58.338555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:58.344529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.345013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.345454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.346172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.346632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.347058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.377614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dfa65407-941b-4360-9295-8c31c585beca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 06 12:00:58.378197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 704/1359] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:58.601373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:58.603505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:58.610565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.611050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.611495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.612192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.612652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.613082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.615967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:58.618168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:58.625183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.625695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.626145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.626848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:58.627306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:58.627734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:58.645473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-783b1d2f-c315-45a7-b0ca-a46452672e74 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048158 Sep 06 12:00:58.646081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 656/1360] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:58.653708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:58.659222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6894847c-3374-4bbc-9b3d-296d802de14b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Sep 06 12:00:58.659787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 705/1361] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:00:59.337153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:59.340096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:59.346221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.346709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.347152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.347849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.348309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.348734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.379417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7ef16a30-096e-449d-b918-929ff9fb21f8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Sep 06 12:00:59.379984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 657/1362] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:59.391093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:59.393558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:59.399695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.400180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.400735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.401977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.402437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.402862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.433979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49600b08-db38-46c9-a64a-41edec921ab1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047593 Sep 06 12:00:59.434472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 706/1363] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:00:59.658449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:59.660661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:59.668072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.668556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.668998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.669729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.670195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.670623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.671945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:00:59.674173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:00:59.681623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.682540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.683300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.684592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:00:59.685344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:00:59.686142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:00:59.701596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9fdf940b-d317-4662-8215-7cfd8c3f35c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047190 Sep 06 12:00:59.702425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 658/1364] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:00:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:00:59.718530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c18f55dd-9909-4a78-8b56-0d6127ffa3da tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051002 Sep 06 12:00:59.719099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 707/1365] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:00:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:00.393143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:00.395418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:00.402034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.402531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.402975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.403686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.404140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.404566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.436698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f63d3ea1-3a5a-4e93-b28d-99e080e254d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047861 Sep 06 12:01:00.437265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 659/1366] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:00.446298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:00.449133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:00.455282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.455766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.456206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.456902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.457359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.457953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.487151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf3750c3-6bb8-47c5-91c6-82200e4224e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 Sep 06 12:01:00.487719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 708/1367] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:00.714950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:00.717111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:00.723646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.724121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.724556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.725355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.726119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.726545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.740278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:00.740278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:00.741418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.741931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.742373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.743103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:00.743557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:00.743978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:00.760180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7ed4d2f4-9a36-4a8c-ba5b-b382c272fc54 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049357 Sep 06 12:01:00.761152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 660/1368] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:00.778872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eb768bef-cbab-4abf-90e3-8a2df8c6ee16 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051524 Sep 06 12:01:00.779370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 709/1369] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:01.448911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:01.450997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:01.456838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.457326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.457787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.458469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.458917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.459335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.489131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c341431e-a362-4a2b-be25-857d9caac84e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Sep 06 12:01:01.489709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 661/1370] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:01.499762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:01.501938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:01.508067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.508554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.508991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.509711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.510692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.511117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.540829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc99106a-603e-40e6-8341-72574ccb9ba8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Sep 06 12:01:01.541562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 710/1371] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:01.773614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:01.775786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:01.782350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.782820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.783249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.783928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.784374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.784790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.791874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:01.794302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:01.800795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.801282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.801756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.802462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:01.802923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:01.803346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:01.815677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63909b39-7d89-4975-a129-bf56b9d0428c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046047 Sep 06 12:01:01.816258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 662/1372] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:01.835354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9208dbf-e0a4-4069-9661-927ffa430676 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047953 Sep 06 12:01:01.835920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 711/1373] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:02.501902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:02.503965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:02.510094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.510843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.511287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.511982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.512438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.512863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.543436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d44241f1-1057-4e17-b425-ae199507a37e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Sep 06 12:01:02.544003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 663/1374] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:02.552943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:02.555131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:02.561247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.561846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.562292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.562999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.563452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.563883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.593474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dfd9edb9-2a79-4a48-8228-bec670e846c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Sep 06 12:01:02.594072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 712/1375] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:02.828700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:02.830858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:02.837302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.837833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.839356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.839748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.840196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.840615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.848900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:02.851217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:02.858691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.859238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.859806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.860681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:02.861298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:02.861976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:02.872072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-67c92b47-3969-4124-be80-877fb2ae3114 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047453 Sep 06 12:01:02.872646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 664/1376] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:02.893092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-14e8dda9-2bc7-43f6-b6c4-4a1112f014f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Sep 06 12:01:02.893671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 713/1377] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:03.556721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:03.559663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:03.565783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.566269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.566704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.567400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.567855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.568283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.606419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:03.607372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:03.608605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:03.613510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-802b2bc6-0a28-47f7-b403-5291d9674f0f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060930 Sep 06 12:01:03.614160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 665/1378] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:03.614626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.615118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.615558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.616271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.616724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.617148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.650349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfd036c3-9b1e-4175-8732-01b22ddff6ef tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Sep 06 12:01:03.651761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 714/1379] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:03.884671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:03.886950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:03.894163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.894652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.895088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.895796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.896247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.896671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.905916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:03.908081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:03.914589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.915081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.915518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.916815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:03.917453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:03.918012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:03.928283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0ab3ddb-bff7-4e07-b600-632822082335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047655 Sep 06 12:01:03.928943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 666/1380] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:03.948254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-562b9c2b-b8af-4441-8edf-97b999985e2b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Sep 06 12:01:03.948830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 715/1381] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:04.626387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:04.628512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:04.634663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.635658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.636108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.636810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.637263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.637716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.663411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:04.665573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:04.669164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-28c8331f-8fb9-46ed-805a-b002d94166d1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046984 Sep 06 12:01:04.669754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 667/1382] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:04.671696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.672185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.672627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.673330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.673821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.674258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.703586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8695b43f-e20a-4cbc-9084-6478caa09d46 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Sep 06 12:01:04.704168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 716/1383] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:04.942815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:04.944964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:04.952020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.952502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.952942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.953633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.954117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.954544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.960311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:04.962528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:04.966220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:04.970399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.970893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.971347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.972039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:04.972500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:04.972925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:04.985325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4700ada9-42f3-4155-a189-60cf8d0d7a8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046501 Sep 06 12:01:04.985930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 668/1384] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:05.003385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66b63272-8f27-47f9-8bb2-aa56456d489f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Sep 06 12:01:05.003948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 717/1385] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:05.681478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:05.683926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:05.690050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:05.690530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:05.690959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:05.691652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:05.692097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:05.692517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:05.717969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:05.720574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:05.724591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8652b973-aaad-4ad3-be5a-8ffc32a5f38b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047126 Sep 06 12:01:05.725174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 669/1386] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:05.727467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:05.728033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:05.728488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:05.729866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:05.730363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:05.730786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:05.761601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8566756c-6732-42d3-9280-f5abf9c9335d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049186 Sep 06 12:01:05.762355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 718/1387] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:05.998958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:06.001194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:06.007904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.008401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.008841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.009549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.010556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.011630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.016698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:06.019178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:06.026996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.027251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.027601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.028330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.028791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.029221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.044963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62b5cd53-ec90-438b-b0aa-09c5ae4be2d3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050723 Sep 06 12:01:06.045752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 670/1388] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:06.061614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a3d9f2d4-d23c-4439-8dd9-4966e934ce8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048830 Sep 06 12:01:06.062230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 719/1389] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:06.737131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:06.739318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:06.745844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.746325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.746756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.747433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.747885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.748301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.774472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:06.776784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:06.777636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0bf83644-a670-4ff2-8b1b-691f29a9649d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Sep 06 12:01:06.778252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 671/1390] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:06.782922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.783412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.783857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.784558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:06.785017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:06.785448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:06.816101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f93f8e5-f364-451f-ad0d-a76e154b0820 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Sep 06 12:01:06.816659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 720/1391] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:07.058174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:07.060256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:07.066748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.067267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.067706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.068402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.069006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.069359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.074104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:07.076256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:07.082642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.083219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.083642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.084247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.084694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.085110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.100152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-517cd9e4-6d05-4542-a1ce-e848a736027a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046391 Sep 06 12:01:07.101376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 672/1392] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:07.115797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c2e60810-bf3c-4583-b01a-61090ba8d27c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Sep 06 12:01:07.116350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 721/1393] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:07.790067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:07.792435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:07.798412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.798886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.799316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.799991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.800439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.800856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.829407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:07.831895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:07.832045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-164e4969-292d-471d-84ff-9a208e6f529c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Sep 06 12:01:07.832555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 673/1394] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:07.838414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.839188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.839639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.840346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:07.840807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:07.841236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:07.860777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:07.874318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f36d9c13-1f3d-405e-be77-b4497a81ad5b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048775 Sep 06 12:01:07.874901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 722/1395] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:08.114246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:08.116403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:08.123630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.124126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.124566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.125265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.125747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.126178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.127724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:08.129925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:08.137105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.137599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.138074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.138785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.139235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.139659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.157048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ceb8e64c-9f70-4e7f-b487-73e043b10e7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046838 Sep 06 12:01:08.157825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 674/1396] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:08.170810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c579038f-429b-4f80-a1e9-efaf1798ffff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046954 Sep 06 12:01:08.171381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 723/1397] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:08.845122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:08.847304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:08.853274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.854471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.854924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.855793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.856254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.856693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.887535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:08.888768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a85658d3-4013-4168-b607-277329618579 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047645 Sep 06 12:01:08.889351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 675/1398] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:08.889795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:08.896114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.896596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.897032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.897760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:08.898216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:08.898638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:08.928425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49583bcb-e191-40da-8aa0-f040882471f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Sep 06 12:01:08.928990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 724/1399] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:09.170009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:09.172140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:09.178164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.178641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.179074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.180271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.180271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.180600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.184390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:09.186416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:09.192842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.193326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.193790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.194595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.194939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.195364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.211633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-551361f4-b37f-4c2c-bf05-8bb15313eb62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046119 Sep 06 12:01:09.212212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 676/1400] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:09.226691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-096c894a-b197-4168-8c4f-b4896b6553a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047200 Sep 06 12:01:09.227256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 725/1401] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:09.901289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:09.903366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:09.905354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:09.910541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.911022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.911454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.912137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.912586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.913000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.940541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:09.942712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:09.944676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac3c37df-738f-44d6-a806-de6c2b152ff2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047616 Sep 06 12:01:09.945255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 677/1402] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:09.949714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.950205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.950641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.951341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:09.951830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:09.952253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:09.982236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eba38d65-184d-4586-a147-219440e7c72e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Sep 06 12:01:09.982793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 726/1403] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:10.224867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:10.227103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:10.234210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:10.234700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:10.235142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:10.235844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:10.236307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:10.236789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:10.240221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:10.242494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:10.249807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:10.250396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:10.251036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:10.252141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:10.252141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:10.252394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:10.268756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c00f135-9879-4a58-bc10-9ab34bb46679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048049 Sep 06 12:01:10.269371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 678/1404] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:10.284008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2435391f-feb6-4b43-a9d1-6793d51a56a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 Sep 06 12:01:10.284572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 727/1405] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:10.957403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:10.959635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:10.966274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:10.966770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:10.967207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:10.967914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:10.968375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:10.968804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:10.995346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:10.998187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:11.000302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-08770f9a-ad6e-4311-b13a-e03fd691d533 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Sep 06 12:01:11.001105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 679/1406] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:11.004189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:11.004673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:11.005111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:11.005846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:11.006300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:11.006723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:11.039272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1b53adb-8efa-41e0-b343-0bfc4e14bde6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049117 Sep 06 12:01:11.039744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 728/1407] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:11.281726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:11.284030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:11.291700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:11.291700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:11.292248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:11.292990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:11.294524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:11.294524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:11.298816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:11.300159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:11.307484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:11.308094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:11.308614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:11.310045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:11.310045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:11.310508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:11.328215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6cfbc351-65ef-4ca7-86fd-c39e55479b15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050451 Sep 06 12:01:11.328841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 680/1408] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:11.346563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3e8dc7cd-a24d-4c63-bb41-94dba2455287 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053198 Sep 06 12:01:11.347127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 729/1409] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:12.012965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:12.015196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:12.021579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.022112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.022553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.023256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.023709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.024134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.052398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:12.054614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:12.055579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0a79282e-262d-4f27-aaa3-bcf0c24bb295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047362 Sep 06 12:01:12.056295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 681/1410] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:12.061314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.061858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.062316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.063052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.063510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.063940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.095541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4658172d-d226-4e36-be12-a050afcffbf8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047007 Sep 06 12:01:12.096138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 730/1411] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:12.341755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:12.343840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:12.350331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.350819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.351260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.351959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.352422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.352852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.359726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:12.361909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:12.369098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.370845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.371306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.372018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:12.372126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:12.372477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:12.372904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:12.386916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-569f1ccd-c40a-4c59-99cc-580c08bb7c98 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049395 Sep 06 12:01:12.387521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 682/1412] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:12.405329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c54979f5-e117-4070-bc3f-f4ece1341cd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049637 Sep 06 12:01:12.405973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 731/1413] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:13.068875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:13.071000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:13.078453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.079039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.079583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.080386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.080850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.081323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.109768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:13.111962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:13.116588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8914f147-ab02-4e28-b1f5-699947bc05a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051840 Sep 06 12:01:13.117170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 683/1414] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:13.118166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.118658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.119097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.120173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.120702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.121133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.153089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-514ca7af-bb0a-40bd-b3b3-3e11581e7ac2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048970 Sep 06 12:01:13.154066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 732/1415] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:13.399835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:13.402616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:13.409183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.409700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.410234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.410984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.412633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.412633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.418595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:13.420780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:13.427158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.427642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.428073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.428769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:13.429224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:13.429720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:13.442159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d46cdeb-db27-41d8-af6a-be326ef8bb24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046108 Sep 06 12:01:13.442736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 684/1416] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:13.460934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3e45314f-3cba-4d70-9528-b3639695a8a4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046947 Sep 06 12:01:13.461502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 733/1417] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:14.129032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:14.131231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:14.138540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.139138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.139680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.140597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.141266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.141818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.167181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:14.169374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:14.174599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dcc3e3b0-edb5-47d5-9d5a-6b2836f50c63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049472 Sep 06 12:01:14.175201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 685/1418] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:14.175718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.176930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.176930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.177388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.177893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.178319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.210396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bcf9f2fd-946c-41cc-9a72-2ed8e77eca0a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Sep 06 12:01:14.210971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 734/1419] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:14.455121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:14.457276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:14.465193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.465870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.466314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.467008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.467453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.467902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.474532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:14.476722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:14.483408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.483901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.484343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.485051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:14.485912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:14.486345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:14.500384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e5a1e22-a5c1-4392-8788-9169a1200dcc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049305 Sep 06 12:01:14.501178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 686/1420] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:14.518524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-62f71b7a-c2e0-46f0-b78e-89af4f7f1fc9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047930 Sep 06 12:01:14.519108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 735/1421] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:15.190783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:15.193243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:15.200387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.200898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.201634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.202567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.203167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.203650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.223813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:15.226599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:15.232852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.233342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.233929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.234544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.235070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.236119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.243312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-98f8f397-ae2a-4030-8c96-7d1e11fdbc07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057402 Sep 06 12:01:15.243759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 687/1422] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:15.270825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aa3eb77c-4aed-4404-b0c7-52c35f7d934a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051033 Sep 06 12:01:15.275739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 736/1423] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:15.513370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:15.515809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:15.522742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.523233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.523717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.524431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.527218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.527597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.533214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:15.537514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:15.549165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.549687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.550129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.550855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:15.551318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:15.551734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:15.564426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-54d21e6a-c65d-46a2-ba72-ae05c8c7a213 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055628 Sep 06 12:01:15.565340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 688/1424] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:15.584624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ce10fe10-65e4-4aad-8fab-01d9afb878fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056111 Sep 06 12:01:15.590192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 737/1425] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:16.257141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:16.260504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:16.266929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.267442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.268527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.269434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.270090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.270643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.283112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:16.285285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:16.292440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.292948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.293391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.294183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.294640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.295068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.305105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f77510ee-902a-4dfe-8b29-da432ab6ff6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051939 Sep 06 12:01:16.307551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 689/1426] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:16.334656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1b4ef39a-4908-402b-a10e-17eed69b050b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055672 Sep 06 12:01:16.335248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 738/1427] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:16.577372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:16.579563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:16.586080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.586570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.587010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.587713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.588277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.588722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.598136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:16.600328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:16.608088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.608575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.609016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.609746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:16.610199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:16.610624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:16.614551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:16.620870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-835e54ff-fdc4-435c-83b1-1567707c88bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047619 Sep 06 12:01:16.621468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 690/1428] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:16.644038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-11889b81-b2f8-4d84-bc82-cc2023b49a91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049900 Sep 06 12:01:16.644619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 739/1429] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:17.319580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:17.321792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:17.328352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.328834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.329297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.330014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.330468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.330894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.349927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:17.352725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:17.359772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.360279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.360727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.361442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.361442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.362766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.374664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41e5cdbc-826a-4466-9ab0-d19149b29582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059045 Sep 06 12:01:17.375263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 691/1430] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:17.402737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dad18bd3-cc8e-400b-8fe0-4ef89959ec29 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057914 Sep 06 12:01:17.403340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 740/1431] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:17.635281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:17.638152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:17.646535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.647074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.647585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.648295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.648757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.649189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.658136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:17.662150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:17.677419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.677694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.679030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.679854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:17.680364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:17.680958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:17.692298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c7b30f9b-4b1a-4353-bcd3-9b0d8517e004 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061759 Sep 06 12:01:17.693325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 692/1432] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:17.727614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f82b294-b75a-448a-8619-597cab5648e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073822 Sep 06 12:01:17.728213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 741/1433] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:18.392052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:18.394823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:18.402733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.403616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.404369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.405151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.405577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.406039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.418500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:18.421205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:18.427911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.428405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.428840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.429620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.430032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.430772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.441173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-520f0e02-5cef-4070-89f6-404374f4607d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053725 Sep 06 12:01:18.441763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 693/1434] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:18.471584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-80c6744a-3abb-4ac7-a1b8-0e2e7a2c00be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058710 Sep 06 12:01:18.471876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 742/1435] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:18.711597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:18.715297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:18.726415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.727030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.727469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.728181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.728766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.730014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.741403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:18.745856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:18.754810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.755411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.755809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.756530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:18.756988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:18.758230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:18.772153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a595fd1-1bd8-4837-984b-3102cb542732 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066475 Sep 06 12:01:18.772980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 694/1436] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:18.800898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a749eecb-97ca-4423-85e7-195c42c1f0ca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063574 Sep 06 12:01:18.801482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 743/1437] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:19.455915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:19.458610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:19.466056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.466542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.466989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.467925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.468382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.468805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.484780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:19.487054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:19.493271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.493862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.494575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.495648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.496702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.497121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.502763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f5d0b49-2a74-4ba9-ad8d-d9ecb3985c54 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051458 Sep 06 12:01:19.503349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 695/1438] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:19.543249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1c131ed8-e15a-404d-805d-6e27524e8a60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062175 Sep 06 12:01:19.544087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 744/1439] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:19.791621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:19.794533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:19.801888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.802379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.802823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.803569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.804026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.804458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.816520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:19.818762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:19.827151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.827643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.828082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.828783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:19.829240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:19.829689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:19.842050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b487cd1-f8ed-40c7-82b8-6da0ce8a58a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056165 Sep 06 12:01:19.842634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 696/1440] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:19.867269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca9b65d9-b390-4243-aaea-875375c0560f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055218 Sep 06 12:01:19.867852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 745/1441] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:20.517419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:20.519802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:20.526728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.527356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.527792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.528488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.528937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.529361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.561204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:20.563403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:20.566626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-55b4f294-9a48-4901-a952-ece52d6f9231 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054113 Sep 06 12:01:20.568061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 697/1442] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:20.573033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.573512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.574010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.574742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.575191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.575660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.610233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca8f4d7a-6f2b-412c-b181-6c19ff1957b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053947 Sep 06 12:01:20.611253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 746/1443] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:20.857712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:20.859872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:20.868313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.869021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.870309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.871418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.872152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.872819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.881138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:20.883334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:20.892027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.893140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.893945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.895184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:20.896178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:20.896913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:20.905331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52bde476-81cc-49a2-9586-45fbe7278c64 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052223 Sep 06 12:01:20.906394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 698/1444] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:20.930673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0bed0306-98da-42e7-819c-ed6e53b823f6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053393 Sep 06 12:01:20.931251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 747/1445] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:21.579731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:21.581868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:21.588554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.589053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.589491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.590227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.590693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.591121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.595230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:21.623960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a332e67b-7085-42d9-8632-dc6f0dd1e729 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048299 Sep 06 12:01:21.624549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 699/1446] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:21.626144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:21.628347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:21.634538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.635515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.635946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.636649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.637091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.637517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.668187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef1b928e-a3c6-4cfb-8f91-f36ea03193df tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045945 Sep 06 12:01:21.668752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 748/1447] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:21.919187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:21.921352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:21.928601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.929144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.929485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.930224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.930725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.931397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.944871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:21.947127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:21.953938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.954429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.954865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.955581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:21.956039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:21.958050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:21.969950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ea8b4ff-ee1c-4e18-aaa9-0139c4174560 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055541 Sep 06 12:01:21.970885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 700/1448] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:21.999469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37e2fa45-c199-4325-a71b-4b32b4ceac5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058548 Sep 06 12:01:22.000077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 749/1449] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:22.636881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:22.638992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:22.645288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:22.645818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:22.646264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:22.646965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:22.647422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:22.647851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:22.678345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7c0bbbac-5270-4866-9e23-f50922664002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 06 12:01:22.678908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 701/1450] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:22.680599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:22.682855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:22.689669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:22.690192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:22.690635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:22.691338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:22.691795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:22.692224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:22.721365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4f2238a4-8827-47a5-9c70-0f0a669ac9ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 06 12:01:22.721944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 750/1451] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:22.984098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:22.986314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:22.992750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:22.993238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:22.993698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:22.994403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:22.994974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:22.995460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.013077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:23.015419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:23.022608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:23.023269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:23.023714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.024432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:23.024891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:23.025316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.026845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-688dd966-6b65-42bd-9f96-824a683a5010 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046868 Sep 06 12:01:23.027380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 702/1452] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:23.059706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-93311791-ccdf-41db-86f1-bc29bb822d3f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051202 Sep 06 12:01:23.060302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 751/1453] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:23.690506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:23.692731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:23.699543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:23.700062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:23.700499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.701200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:23.701675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:23.702104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.734467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:23.734725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b48454b7-96cf-44f9-a2b5-bd50422e3b73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048020 Sep 06 12:01:23.735422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 703/1454] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:23.736744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:23.742957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:23.743447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:23.743888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.744596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:23.745121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:23.745787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:23.777329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c116654f-d429-4b3d-80f7-12d36c53e2c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Sep 06 12:01:23.777589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 752/1455] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:24.039592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:24.041791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:24.048297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.048790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.049264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.050003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.050460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.050887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.072691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:24.075430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:24.082896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.083135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-24723f00-f87a-400c-a78e-c28b9175292e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047462 Sep 06 12:01:24.083384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.083697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 704/1456] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:24.083825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.084545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.084994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.085423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.117983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eaff4e18-3ea3-4c76-9337-919b04fb8fd6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049433 Sep 06 12:01:24.118575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 753/1457] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:24.747904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:24.750310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:24.756448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.756942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.757382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.758119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.758571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.759005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.789207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:24.789742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9855900f-d3c9-4f22-aab7-f250e9587b1e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Sep 06 12:01:24.790336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 705/1458] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:24.791398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:24.798740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.799241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.799661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.800354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:24.800806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:24.801229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:24.835411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0fe3f213-4ff4-49e8-82e8-f59ad6e0d237 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050705 Sep 06 12:01:24.835976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 754/1459] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:25.096665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:25.098916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:25.106468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.106957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.107390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.108087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.108533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.108951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.131262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:25.133678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:25.140992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.141489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.141973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.142088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-963c899e-1621-4a7e-af9f-30c5b922757b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049840 Sep 06 12:01:25.142652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 706/1460] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:25.143102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.143393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.143827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.172578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:25.178710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-db7b6fc1-9527-4802-ac8d-12d310f73919 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051692 Sep 06 12:01:25.179456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 755/1461] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:25.803448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:25.805668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:25.812580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.813076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.813517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.814256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.814711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.815139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.847965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63664182-3d3a-4cc0-89ff-39e3a8106d6b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Sep 06 12:01:25.848573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 707/1462] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:25.852814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:25.852814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:25.860714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.861201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.861667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.862406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:25.862863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:25.863309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:25.904089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc977d30-0cd4-4b2d-adec-a57337fc3a52 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058406 Sep 06 12:01:25.904689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 756/1463] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:26.157597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:26.159832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:26.166611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.167180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.167847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.168568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.169024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.169460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.192227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:26.194597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:26.201890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.202474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.202972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.203205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bf5f946a-1dc9-47b6-9d2a-3ed6219600fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049675 Sep 06 12:01:26.203802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 708/1464] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:26.203956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.204380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.204892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.236988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-02c4f948-33b2-4ed4-8190-00446dec46c6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048635 Sep 06 12:01:26.237570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 757/1465] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:26.863275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:26.865498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:26.872724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.873214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.873676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.874394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.874846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.875270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.909488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c572ff67-b5c9-4efa-8ba2-2bd34b198bbe tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050248 Sep 06 12:01:26.910361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 709/1466] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:26.917814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:26.920013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:26.926807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.927292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.927726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.928430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:26.928887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:26.929311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:26.963217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-556918ac-d693-44aa-af77-4ac2b3e0925e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050193 Sep 06 12:01:26.964894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 758/1467] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:27.220594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:27.224323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:27.236293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.237188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.238029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.239317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.240145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.240911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.251552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:27.253996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:27.262040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.262956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.263466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.264264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.264789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.265286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.280733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63f37539-05dd-4aeb-a739-6a853fcdd72e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067705 Sep 06 12:01:27.281326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 710/1468] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:27.300273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-53270029-c305-48e5-b1c4-0405b5106298 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052694 Sep 06 12:01:27.300893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 759/1469] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:27.922058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:27.924189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:27.930137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.930622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.931056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.931734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.932191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.932953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.963075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-451bbdb0-7aea-4aea-864d-f038a71f2575 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Sep 06 12:01:27.964451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 711/1470] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:27.976713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:27.978905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:27.986199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.986683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.987114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:27.987806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:27.988277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:27.988694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:28.020688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-db2e7b15-7665-4a7d-92f1-4637efa0b6c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048151 Sep 06 12:01:28.021255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 760/1471] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:28.296875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:28.299092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:28.305614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:28.306046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:28.306489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:28.307960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:28.308325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:28.308757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:28.313522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:28.315727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:28.321796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:28.322289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:28.322869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:28.324775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:28.325235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:28.325681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:28.340136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6c68ea7-2978-46ee-aec2-e12b0031b9f5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047201 Sep 06 12:01:28.340716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 712/1472] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:28.357324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-433275a6-e9af-48e7-9b86-6c5f2427020a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Sep 06 12:01:28.357933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 761/1473] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:28.976705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:28.978907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:28.985880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:28.986371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:28.986813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:28.987514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:28.988280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:28.988715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.020938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9a3005c0-aa02-432d-abef-423a8cae46c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048206 Sep 06 12:01:29.021519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 713/1474] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:29.036249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:29.038450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:29.045346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:29.045876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:29.046316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.047024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:29.047474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:29.047896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.078350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3d66092f-81db-4a13-9526-94310c6c10a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Sep 06 12:01:29.078927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 762/1475] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:29.353580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:29.355841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:29.364554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:29.365096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:29.365567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.366409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:29.366931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:29.367389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.370342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:29.372608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:29.378668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:29.379160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:29.379608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.380313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:29.380807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:29.381200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:29.403425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ff1ffb19-66fd-42c9-a93c-25eff5c42b3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053902 Sep 06 12:01:29.404002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 714/1476] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:29.415912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-005c5baa-0ada-4047-be3c-baca44d03a28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049778 Sep 06 12:01:29.416562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 763/1477] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:30.032777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:30.035159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:30.041394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.041905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.042919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.043633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.044094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.044522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.075118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:30.080860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9ab0ad6a-2680-44d2-b48f-76e88cb9e573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052114 Sep 06 12:01:30.081472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 715/1478] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:30.092295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:30.094605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:30.101857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.102349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.102781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.103487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.103940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.104353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.136283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-28a59e76-05ea-4e9b-95b9-6af531a7b467 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Sep 06 12:01:30.136894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 764/1479] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:30.416214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:30.419026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:30.425704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.426202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.426652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.427388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.427851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.428280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.428775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:30.431141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:30.437168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.437678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.438133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.438848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:30.439554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:30.439804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:30.460922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0e852f69-c7ae-4923-a552-a8bf314fa636 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048618 Sep 06 12:01:30.461495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 716/1480] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:30.470675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6fb3d96-ed8f-48cd-9c8a-4173d2a6cb6a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Sep 06 12:01:30.471249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 765/1481] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:31.095560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:31.097934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:31.104597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.105114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.105677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.106455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.106914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.107405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.142683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-21dc0ef2-ae27-4bdf-8a05-45ccab1c03a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051353 Sep 06 12:01:31.143584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 717/1482] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:31.150981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:31.155618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:31.162731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.163226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.163681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.164430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.165054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.165518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.201307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fec09afc-cca7-4ffb-9245-ab724f22f0a3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054447 Sep 06 12:01:31.201967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 766/1483] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:31.474540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:31.476757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:31.483432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:31.483957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.483957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.484371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.485073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.485532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.485673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:31.485991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.487496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:31.493139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.493629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.494101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.494799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:31.495507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:31.496400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:31.517105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-002dbc00-57c8-41a8-91dd-83bacbfada15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046479 Sep 06 12:01:31.517698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 718/1484] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:31.528694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6181b7ea-72a1-482e-b0c1-99bd22e4dc73 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049319 Sep 06 12:01:31.529272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 767/1485] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:32.157795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:32.160546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:32.166904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.167884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.168159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.168941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.169421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.169909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.201260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ac3e072-a778-4004-aa53-e6f9eb40218d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Sep 06 12:01:32.202081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 719/1486] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:32.214808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:32.217036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:32.223660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.224151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.224589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.225320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.225815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.226243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.266142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-946b16a4-cac5-44e9-b062-188f86b22660 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055904 Sep 06 12:01:32.266795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 768/1487] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:32.530098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:32.532337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:32.538747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.539243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.539681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.540288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:32.540716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.540813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.541229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.542602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:32.548504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.548998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.549435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.550236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:32.550698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:32.551126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:32.572483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4362cd01-1a58-4895-8708-6bf068c87c20 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046370 Sep 06 12:01:32.573068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 720/1488] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:32.582635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-56153843-dc18-4f70-8c1f-ac9208fb389a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Sep 06 12:01:32.583201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 769/1489] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:33.212844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:33.215536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:33.221556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.222098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.222541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.223236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.223692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.224120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.253941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8954e875-8df7-4dbc-8a98-fa69d84222bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Sep 06 12:01:33.254515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 721/1490] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:33.279070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:33.281117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:33.288093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.288582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.289020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.289752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.290213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.290642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.320741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58fe5d8b-8b7b-4843-a391-3f3a05eec3bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Sep 06 12:01:33.321300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 770/1491] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:33.585917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:33.588142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:33.595892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:33.597312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.598111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:33.598492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.605052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.605052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.605902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.606067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.606854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.607205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:33.607323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.607666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:33.607791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.608165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:33.639030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e099ff1-1122-41cf-b6f3-4cf04b5ae1a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047141 Sep 06 12:01:33.639666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 771/1492] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:33.639821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cfa50d40-f601-42dd-bdda-8792cda4e93b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057781 Sep 06 12:01:33.640194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 722/1493] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:34.266896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:34.269416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:34.275529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.276009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.276978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.277812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.278264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.278681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.297236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:34.310770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f043721-184a-47bb-81a7-5817e72daf77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047811 Sep 06 12:01:34.311360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 772/1494] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:34.333581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:34.335767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:34.342554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.343042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.343482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.344175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.344632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.345058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.374573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20e29189-6e40-4596-844e-95ff995ccf25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Sep 06 12:01:34.375155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 723/1495] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:34.652443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:34.653619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:34.655466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:34.656305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:34.661535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.662057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.662493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.662609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.663016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.663187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.663449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.663821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.664154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:34.664292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.664600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:34.665405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:34.699771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-319e51c4-0947-4aab-8851-9b0c818ffd8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051798 Sep 06 12:01:34.700361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 773/1496] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:34.703419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1114fe69-ee61-42eb-b1c6-c2e016f655b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055035 Sep 06 12:01:34.703999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 724/1497] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:35.323302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:35.325544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:35.332281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.332766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.333213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.333941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.334403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.334960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.377621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-94469159-716e-4f53-b72a-f782c7e158b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058189 Sep 06 12:01:35.378216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 774/1498] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:35.388311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:35.390556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:35.396949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.397431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.397899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.398586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.399041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.399464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.431133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ffdd5bc-bfe1-4025-90e3-50798d69e6ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047344 Sep 06 12:01:35.431902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 725/1499] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:35.712284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:35.714494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:35.716510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:35.718828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:35.721000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.721604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.721958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.722662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.723120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.723542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.725065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.725613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.726092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.726774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:35.727242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:35.727686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:35.755465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-32f5d322-4e40-4334-8720-7e17a5829d48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Sep 06 12:01:35.756036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 775/1500] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:35.766706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-693a198c-de30-4f15-aa88-91f3e89d6d0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054910 Sep 06 12:01:35.767214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 726/1501] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:36.390591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:36.392790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:36.399571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.400059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.400511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.401201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.401675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.402118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.434931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c12e0b11-d0cc-4c4a-9892-7f52997ebf43 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048514 Sep 06 12:01:36.435594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 776/1502] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:36.443630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:36.445809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:36.447728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:36.454203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.454698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.455134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.455837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.456291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.456717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.485699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ebfe97ae-eae4-4c93-a36b-07c5f9794db3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Sep 06 12:01:36.486262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 727/1503] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:36.768372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:36.770488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:36.776377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.776861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.777299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.778015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.778472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.778938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.780047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:36.783432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:36.790046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.791650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.792345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.793221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:36.794526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:36.795120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:36.809092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9651e62a-e3a4-4397-b918-0ef5b089bfe4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Sep 06 12:01:36.810621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 777/1504] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:36.826354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eaf8a269-344a-4057-a2d9-ca6b504d8e34 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050839 Sep 06 12:01:36.826911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 728/1505] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:37.448438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:37.451461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:37.457971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.458462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.458908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.459625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.460092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.460523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.490475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e87df00a-cbac-4984-90a4-b1c8789ab9c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Sep 06 12:01:37.491040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 778/1506] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:37.498094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:37.500324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:37.506381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.506870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.507313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.508002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.508455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.508877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.540285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b91831ac-9381-4208-912b-53c4d3ba866e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Sep 06 12:01:37.540844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 729/1507] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:37.822824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:37.825050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:37.832047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.832656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.833125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.833880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.834331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.834755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.841320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:37.843600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:37.850170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.850717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.851194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.852193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:37.852703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:37.853230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:37.870172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f3be9c9-1264-429e-9ec8-976fec7c9337 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051305 Sep 06 12:01:37.870856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 779/1508] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:37.886104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a57a819-e27b-4b66-9dd3-d78846b24493 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049320 Sep 06 12:01:37.886680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 730/1509] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:38.503265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:38.505358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:38.512078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.512562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.513047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.513784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.514239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.514667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.547257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a737a82a-1ef7-4b48-9b75-0a1183e983ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047722 Sep 06 12:01:38.551830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 780/1510] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:38.553125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:38.555303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:38.561520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.562049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.562492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.563204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.563663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.564086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.596398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f78bed48-ae89-49b5-87c9-c918f4f0cd30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047770 Sep 06 12:01:38.596969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 731/1511] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:38.882313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:38.884561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:38.891215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.891710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.892144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.892846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.893558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.894123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.900094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:38.902426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:38.909992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.910726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.911233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.912003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:38.912522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:38.912950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:38.925363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dee4af1a-2435-4fd3-a30b-941a7bb500a0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 Sep 06 12:01:38.926158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 781/1512] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:38.930844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:38.943656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6f6df14-f3a7-4701-8cef-6b7c6cc34d14 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048150 Sep 06 12:01:38.944217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 732/1513] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:39.560787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:39.563004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:39.569471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.569999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.570443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.571135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.571593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.572024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.601960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f56ab440-189f-4087-b389-80ff3b7693a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Sep 06 12:01:39.602980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 782/1514] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:39.609306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:39.611481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:39.617465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.617997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.618432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.619127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.619582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.620007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.651415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3276b841-4184-41b3-b026-dc129e8c284a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Sep 06 12:01:39.651984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 733/1515] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:39.943242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:39.945411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:39.953332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.953851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.954286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.955177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.955668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.956235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.957262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:39.959608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:39.965777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.966462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.967139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.967726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:39.969235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:39.969760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:39.989364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-30d1d7fa-9253-416f-8aab-08fe39b24de8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054917 Sep 06 12:01:39.993879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 783/1516] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:40.011694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fe9ab845-ba81-4e87-ac65-32caf91dd6a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058355 Sep 06 12:01:40.012262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 734/1517] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:40.614685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:40.616744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:40.624074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:40.624569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:40.625013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:40.625753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:40.626226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:40.626657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:40.658852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cfdcdf89-6892-459c-bb3f-2f165b8b019a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048127 Sep 06 12:01:40.659427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 784/1518] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:40.664333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:40.666570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:40.673292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:40.673825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:40.674264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:40.674963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:40.675447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:40.675874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:40.706795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ad3ae12-36a8-44ea-a625-ff442d2f54de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Sep 06 12:01:40.707450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 735/1519] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:41.001240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:41.003464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:41.009564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.010086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.010516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.011368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.011673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.012090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.025362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:41.027993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:41.035338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.035820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.036250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.036945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.037391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.037852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.046770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9db051fb-2672-4b65-9919-5d165fc384db tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049406 Sep 06 12:01:41.047461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 785/1520] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:41.069351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7bd3f63f-a839-4f44-8c61-cb14c5d8681a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048480 Sep 06 12:01:41.069943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 736/1521] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:41.672067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:41.674280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:41.680716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.681231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.681663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.682357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.682815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.683242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.714931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-865eb01b-ab00-4ee2-b23b-5bcc23b11c07 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047303 Sep 06 12:01:41.715524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 786/1522] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:41.720021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:41.722391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:41.728784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.729271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.729794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.730539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:41.730987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:41.731407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:41.764251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-36f39125-4315-40b1-9f14-5d9912c1c829 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Sep 06 12:01:41.764725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 737/1523] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:42.058603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:42.061910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:42.067904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.068421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.068856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.069551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.070041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.070467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.082435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:42.084641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:42.091116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.091613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.092087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.092795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.093265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.093716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.104434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b0bd73b2-e3c4-4340-b95e-919ff6ac701a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049800 Sep 06 12:01:42.105208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 787/1524] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:42.125973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e00d6c3-2c0f-43a0-953c-e52cdcb30dfb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047587 Sep 06 12:01:42.126549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 738/1525] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:42.729018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:42.731197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:42.738313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.738800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.739239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.739936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.740392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.740813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.774407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c5eaf19-3056-4e33-998b-fd1f657c895e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049218 Sep 06 12:01:42.774895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 788/1526] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:42.776472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:42.779326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:42.785396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.785920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.786360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.787057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:42.787515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:42.787946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:42.816670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ecda0dc-97c0-4ae0-9cbc-c6accacc4ec6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Sep 06 12:01:42.817246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 739/1527] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:43.118358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:43.120425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:43.127754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.128243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.128685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.129389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.129877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.130304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.135063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:43.139929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:43.142133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:43.149219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.149737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.150177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.150879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.151323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.151740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.165136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca265fda-d5f8-4401-a7f4-5c9fe6dbf921 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050807 Sep 06 12:01:43.165987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 789/1528] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:43.183952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-626d2cd8-e892-4acc-81a8-30a5030c3618 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049133 Sep 06 12:01:43.184536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 740/1529] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:01:43.792053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:43.795978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:43.807596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.808498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.809291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.810782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.811645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.812447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.828514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:43.830738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:43.836999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.837487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.837961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.838672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:43.839135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:43.839561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:43.869752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c0e76ec-b1c8-42ee-838f-d6b4e6149e76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085072 Sep 06 12:01:43.870836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 790/1530] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:43.871666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc676db3-d26d-4a1e-b171-3d7cd56fb78f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047073 Sep 06 12:01:43.872256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 741/1531] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:44.178774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:44.181303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:44.187966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.188453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.188916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.189611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.190092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.190518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.196692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:44.199008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:44.206101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.206594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.207030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.207745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.208206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.208676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.227985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3bed24d4-fb09-4939-83b7-f4f233b9e10c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052579 Sep 06 12:01:44.233012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 791/1532] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:44.240547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d612be98-64f8-47f9-bb8e-12af31626495 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047802 Sep 06 12:01:44.241138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 742/1533] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:44.883440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:44.885695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:44.888462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:44.890729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:44.892796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.893547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.894032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.894754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.895216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.895645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.897605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.898142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.898587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.899306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:44.899789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:44.900220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:44.930157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-048958d0-d62d-4bc5-9c03-fca0f999c976 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 Sep 06 12:01:44.930751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 792/1534] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:44.933352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-121d40e6-2216-4bcd-8416-3201e09c4ff6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Sep 06 12:01:44.934199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 743/1535] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:45.240774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:45.243102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:45.249545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.250084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.250533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.251256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.251739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.252153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.252956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:45.255180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:45.262098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.262592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.263050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.263947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.264213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.264628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.290020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21f085b8-15aa-4964-a5ac-48b339bfb380 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052680 Sep 06 12:01:45.290442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 793/1536] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:45.304093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-84f6f0ef-c93a-4586-94d4-69d8a922dde5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055346 Sep 06 12:01:45.304658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 744/1537] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:45.944754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:45.946638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:45.947004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:45.948776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:45.954471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.954968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.955405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.955526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.955964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.956091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.956408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.956542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.956969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.957109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:45.957571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:45.958029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:45.989997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-39537390-586b-4784-a8df-c6e572c90884 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Sep 06 12:01:45.990590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 745/1538] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:45.996399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2cc9e5f0-f5e0-46cf-9b2b-86cbb4457596 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055059 Sep 06 12:01:45.997043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 794/1539] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:46.302759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:46.304896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:46.311951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:46.312431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:46.312861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:46.313549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:46.314018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:46.314438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:46.316961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:46.319695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:46.325614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:46.326139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:46.326574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:46.327281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:46.327742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:46.328179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:46.344708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc193140-6dbc-42ed-81c0-53c1881ecde8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Sep 06 12:01:46.345453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 746/1540] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:46.361248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-266c3100-6b43-4780-b62b-5e74ee6c7182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048202 Sep 06 12:01:46.361855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 795/1541] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:47.002596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:47.004825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:47.009448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:47.011314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.011589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:47.011804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.012516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.013819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.014281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.014707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.018950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.019430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.019863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.020554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.021000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.021418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.045492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3bec52fa-9193-4ab0-a241-cd0568308408 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Sep 06 12:01:47.046106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 747/1542] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:47.051786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6cb5a32f-3c73-46cc-ab45-1b07ab2dca0d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Sep 06 12:01:47.052353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 796/1543] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:47.356686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:47.358846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:47.365456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.365971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.366422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.367147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.367608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.368032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.374099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:47.376253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:47.382197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.382687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.383161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.383867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:47.384320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:47.384750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:47.398331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e2acd5e-3c49-42e5-8906-80e5f4e850d9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045701 Sep 06 12:01:47.398914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 748/1544] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:47.421390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-51b50f6f-2466-408f-b7a5-318673baaad2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051465 Sep 06 12:01:47.422003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 797/1545] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:48.057627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:48.059700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:48.064295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:48.065783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.066264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.066532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:48.066695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.067382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.067829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.068249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.071898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:48.072994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.073596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.074114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.074823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.075285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.076667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.099303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-df2600b9-17e0-42f2-ab04-ffc566ccb19c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Sep 06 12:01:48.099871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 749/1546] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:48.107548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9930059f-4d54-4611-b587-095ff0e6804f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Sep 06 12:01:48.108119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 798/1547] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:48.410961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:48.413178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:48.420225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.420707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.421150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.421877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.422337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.422769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.434497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:48.436682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:48.442758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.443246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.443688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.444386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:48.444847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:48.445273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:48.452081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-43e7782d-d43f-4402-bdc3-8c8d0253d2dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 06 12:01:48.452762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 750/1548] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:48.477160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1bdf0ccd-c771-49bf-ae1c-b9f48deba106 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046701 Sep 06 12:01:48.477774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 799/1549] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:49.112766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:49.114934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:49.119741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:49.120982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.121460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.121930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.122045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:49.122937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.123235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.123657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.128563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.129056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.129498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.130233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.130692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.131119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.153390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cd699f26-b178-4576-8c65-ee08ded7ee97 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Sep 06 12:01:49.154995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 751/1550] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:49.162257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fed92b3e-4199-4d66-965b-421629b2cc90 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 Sep 06 12:01:49.162838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 800/1551] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:49.465253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:49.468108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:49.474521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.474999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.475438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.476128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.476585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.477013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.491483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:49.493667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:49.500846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.501340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.501810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.502514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:49.502969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:49.503425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:49.506814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d3d112e3-e930-4597-8454-38730ab32bfe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Sep 06 12:01:49.507391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 752/1552] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:49.539009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd56b501-3526-464f-bbb1-b1c26b98bfdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052384 Sep 06 12:01:49.539587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 801/1553] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:50.166932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:50.169672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:50.175313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:50.176265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.176753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.177196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.177449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:50.178040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.178492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.178919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.184017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.184508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.185532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.186347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.186811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.187242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.210110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d97535e2-117a-47f9-845d-f6fbb47cd719 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Sep 06 12:01:50.210683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 753/1554] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:50.217259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37516972-902b-49c1-85e9-ff71fe4239e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045938 Sep 06 12:01:50.217852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 802/1555] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:50.519809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:50.521951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:50.528890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.529388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.529974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.530573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.531044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.532655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.552007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:50.554186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:50.560110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.560641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.561083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.561834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:50.562294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:50.562726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:50.563589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-42cfed54-679e-4428-846a-6ce512d6f82a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048096 Sep 06 12:01:50.564196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 754/1556] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:50.593470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0fa5fa10-d334-45b1-8516-dd86edfb15a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045326 Sep 06 12:01:50.594165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 803/1557] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:51.223261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:51.225508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:51.229407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:51.231519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.231730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:51.232034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.232469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.233163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.233612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.234065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.238006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.238506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.238949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.239653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.240110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.240541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.266138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4967880d-34a3-4ba1-9ffb-c785078d47f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046753 Sep 06 12:01:51.266725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 755/1558] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:51.272639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-511f130b-002e-41fa-abec-5956596feb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Sep 06 12:01:51.273209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 804/1559] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:51.577326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:51.579540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:51.586523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.587075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.587572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.588290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.588790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.589335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.605522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:51.608380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:51.614420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.614906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.615349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.616048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:51.616501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:51.616926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:51.623140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d4e0963-b0e1-41d9-98d5-5512ab76e7e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050782 Sep 06 12:01:51.623715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 756/1560] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:51.645414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:51.651014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9de37ec0-976f-404f-a703-9c28718c02c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049420 Sep 06 12:01:51.651589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 805/1561] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:52.278852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:52.281180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:52.284523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:52.287418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.287611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:52.287928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.288351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.289055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.289683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.290131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.295145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.295825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.296273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.296983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.297469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.297924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.324113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b0b0e837-9312-496a-ae63-81419397f36e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 Sep 06 12:01:52.325100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 757/1562] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:52.330562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a1711c8-b8a8-4cef-adcd-0d8063e48c56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049934 Sep 06 12:01:52.331145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 806/1563] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:52.636176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:52.638794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:52.645521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.646058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.646496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.647190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.647645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.648071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.665805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:52.667970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:52.674589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.675071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.675492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.676187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:52.676635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:52.677052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:52.678365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81f434ae-c14e-4513-b898-032ca10be2b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Sep 06 12:01:52.678941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 758/1564] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:52.706283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f8439b70-dcf5-4bc8-afa5-9c130c5b9620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044468 Sep 06 12:01:52.706846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 807/1565] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:53.336770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:53.339057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:53.343347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:53.345505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:53.346288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.346777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.347212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.347916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.348370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.348797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.352577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.353056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.353490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.354208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.354656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.355073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.379765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-abcb8a9f-d883-4d87-ae54-b2bb0d142670 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Sep 06 12:01:53.380332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 759/1566] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:53.386456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2ef2b90a-4af8-4053-bc6b-26fc7024f2ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047563 Sep 06 12:01:53.387016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 808/1567] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:53.691513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:53.693693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:53.700013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.700485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.700911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.702252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.702705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.703125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.719253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:53.721417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:53.727381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.727881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.728394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.729099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:53.729554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:53.730018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:53.732019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c4e1bd10-9e74-451f-b8b6-e3f7c5c64b8a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Sep 06 12:01:53.732766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 760/1568] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:53.760636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-593c86e7-867e-490a-b649-61e76a001a73 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045634 Sep 06 12:01:53.761203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 809/1569] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:54.391930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:54.394300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:54.400322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:54.400526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.400823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.401300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.402020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.402479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.402910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.403023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:54.411654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.412144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.412588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.413293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.413782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.414211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.437051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74064d37-84cf-4a2e-b3ee-3ff583a55a08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049159 Sep 06 12:01:54.437622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 761/1570] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:54.444746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90f93894-4a63-4c74-ac66-9db8f10c8bd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048373 Sep 06 12:01:54.445309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 810/1571] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:54.745043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:54.747241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:54.754550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.755035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.755477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.756173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.756629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.757054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.774519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:54.776698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:54.783275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.783758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.784195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.784907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:54.785376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:54.785825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:54.790432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7fb8da53-c853-4d72-8004-3c07b48530a7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Sep 06 12:01:54.791012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 762/1572] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:54.815777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3199e8de-468d-4fb6-8509-894622b45403 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045348 Sep 06 12:01:54.816346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 811/1573] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:55.449627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:55.452448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:55.457638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:55.458962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.459452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.459894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.460020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:55.460591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.461045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.461469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.466524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.468334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.468821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.469528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.470016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.470445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.492907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3ce1f14b-71fe-4e1b-bfd1-9430a5960573 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047181 Sep 06 12:01:55.493491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 763/1574] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:55.503921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3faf8f5-a45f-4278-b48f-68683e623fc2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050904 Sep 06 12:01:55.504488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 812/1575] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:55.802894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:55.804986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:55.812109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.812594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.813032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.813750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.814216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.814669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.829339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:55.831507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:55.837429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.838011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.838441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.839131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:55.839580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:55.840001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:55.845606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e42a1c7c-6cd7-4b94-9ce5-509d65656789 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Sep 06 12:01:55.846206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 764/1576] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:55.869477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27e37a95-bfde-4393-964b-e2b976ae4c5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044918 Sep 06 12:01:55.870063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 813/1577] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:56.505614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:56.507747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:56.513860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.514469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.514824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.515519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.515973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.516398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.517283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:56.519713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:56.525866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.526357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.526796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.527498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.527947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.528378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.542585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:56.548942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f12073f9-ff35-4a79-a589-c7e492fad450 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047501 Sep 06 12:01:56.549520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 765/1578] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:56.560001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c235a7c0-8271-4520-a11a-53f9816e130c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047665 Sep 06 12:01:56.560581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 814/1579] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:56.858773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:56.860856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:56.867757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.868244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.868683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.869415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.869918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.870343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.882842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:56.885033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:56.891818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.892420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.892973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.894089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:56.894649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:56.895232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:56.901480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d6d0c82e-b485-4a33-9d14-cbbc326507b3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 Sep 06 12:01:56.902094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 766/1580] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:56.928896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ce4b221-b89f-4db0-bb1c-f78c74d15a88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050112 Sep 06 12:01:56.929465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 815/1581] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:57.561746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:57.564106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:57.570425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.570921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.571362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.572060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.572460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:57.572582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.572940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.574720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:57.586528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.587021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.587454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.588785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.588785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.589020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.610205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9cf66adc-3b24-4ea9-8ba4-0a361bcaa4d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053280 Sep 06 12:01:57.610789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 767/1582] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:57.619942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dcb38197-404b-4188-87d6-ee4681da9430 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051371 Sep 06 12:01:57.620506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 816/1583] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:57.914593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:57.916757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:57.923853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.924354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.924786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.925462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.925930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.926349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.941090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:57.943271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:57.945135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:01:57.952856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.953757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.954303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.955023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:57.955563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:57.956137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:57.962227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c3f4a29b-0063-4d35-90f6-bfd16ce17d21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051517 Sep 06 12:01:57.962831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 768/1584] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:57.994487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e66b408-2e6c-4e73-8d84-2adf5e5c1335 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057193 Sep 06 12:01:57.995365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 817/1585] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:58.623699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:58.625734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:58.631949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:58.632432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:58.632698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:58.632868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:58.633577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:58.634063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:58.634495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:58.635130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:58.642585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:58.643080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:58.643773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:58.644486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:58.644942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:58.645474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:58.668492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ee690e90-4ff1-4d7c-bcb7-5ecc046ad24f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Sep 06 12:01:58.669118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 769/1586] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:58.679103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-db6bf7e6-11d2-4b27-ade1-855a7783cb78 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Sep 06 12:01:58.679725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 818/1587] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:01:58.976724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:58.978973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:58.985894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:58.986381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:58.986822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:58.987516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:58.987972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:58.988398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.006799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:59.008937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:59.015531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:59.016041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:59.016476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.017174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:59.017631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:59.018090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.020588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a37fdf79-c310-485d-9710-db80b133777b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047766 Sep 06 12:01:59.021163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 770/1588] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:59.049222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-182f7cee-f319-4b67-a6df-3edc24d3e800 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046335 Sep 06 12:01:59.049819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 819/1589] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:01:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:01:59.681475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:59.683757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:59.690057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:59.690554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:59.691030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.691604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:01:59.691728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:59.692174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:59.692602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.693762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:01:59.700201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:59.700695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:59.701135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.701908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:01:59.702369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:01:59.702792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:01:59.723589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7157055-36f0-49d2-8c39-3223085ae122 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Sep 06 12:01:59.724175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 771/1590] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:01:59.733853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3129026-9a69-40dc-87bd-a325b45243ba tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Sep 06 12:01:59.734423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 820/1591] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:01:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:00.034051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:00.036155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:00.042584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.043110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.043610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.044430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.044981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.045448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.062260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:00.065138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:00.071406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.071895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.072353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.073057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.073515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.073972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.077118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1158e56d-504b-4d42-89aa-3c8813079ef7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047937 Sep 06 12:02:00.079376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 772/1592] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:00.105224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3df73087-2f34-43d2-9208-c60d9508dc01 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047333 Sep 06 12:02:00.105812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 821/1593] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:00.737083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:00.740522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:00.746621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:00.747725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.748261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.748769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:00.748900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.749673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.750969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.751400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.756865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.757467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.758040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.758771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:00.759356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:00.759855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:00.779352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:00.782819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-53aed572-d7da-4aeb-a7f0-ef7f6404d2b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050664 Sep 06 12:02:00.783402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 773/1594] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:00.793311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f4861af2-6667-42b2-8afb-96d4dabb9c0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050654 Sep 06 12:02:00.793908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 822/1595] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:01.092822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:01.095037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:01.101390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.101911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.102391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.103121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.103623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.104080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.118015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:01.120273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:01.127437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.127931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.128372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.129328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.129530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.130127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.135022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-864d75a1-e96c-4db2-9a80-5b9407b1a810 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Sep 06 12:02:01.135596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 774/1596] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:01.161403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a43a5ce0-9752-4aa1-825f-c11df2fc8269 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047324 Sep 06 12:02:01.162002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 823/1597] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:01.795482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:01.798414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:01.804735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.805222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.805682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.806392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.806844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.807249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:01.807423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.809432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:01.816063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.816605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.817138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.817861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:01.818324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:01.819487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:01.837953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-325de65b-3b96-4592-8b3a-4b5a384ba3ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Sep 06 12:02:01.838530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 775/1598] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:01.851920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-18d591ca-ebc4-4286-b4df-640b9ed22b41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048989 Sep 06 12:02:01.852544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 824/1599] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:02.148704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:02.150816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:02.158505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.159104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.159691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.160416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.160873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.161288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.174194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:02.176324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:02.182339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.182832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.183270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.183974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.184432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.184863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.192769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bcb394e7-091e-4a7e-ba3e-4d911f060c02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048137 Sep 06 12:02:02.193360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 776/1600] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:02.218534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a4a6c4f-e097-4a78-8717-070fac577fc3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048387 Sep 06 12:02:02.219886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 825/1601] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:02.851089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:02.853309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:02.855357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:02.861565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.862081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.862519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.863225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.863682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.864109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.865477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:02.867659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:02.874180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.874709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.875159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.877168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:02.877702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:02.878100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:02.895655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ca0ec85-faaa-44b8-9fdd-aa97f7756849 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Sep 06 12:02:02.896281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 777/1602] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:02.911043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1705fe46-2efe-4776-91c7-e2a80348b09f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050666 Sep 06 12:02:02.911619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 826/1603] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:03.205660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:03.207857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:03.214807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.215311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.215736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.216438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.216907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.217324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.232126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:03.235780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:03.245010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.245546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.246040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.246734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.247186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.247602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.251249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c6af8664-e64d-4cae-9e75-4424ffe1a506 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049604 Sep 06 12:02:03.252126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 778/1604] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:03.281531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4376d163-ef24-4c47-8562-fe481ea19951 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053341 Sep 06 12:02:03.282131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 827/1605] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:03.908801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:03.911053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:03.913251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:02:03.913405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:02:03.919607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.920097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.920539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.921239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.923385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:03.924721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.925179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.925623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:03.933160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.933693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.934121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.934836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:03.935297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:03.935728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:03.961509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4abd8579-60d9-456f-99f7-6edffcae5502 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056875 Sep 06 12:02:03.962920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 779/1606] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:03.973120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-434599da-83b6-41be-8beb-6dc7f7568b2c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053595 Sep 06 12:02:03.973740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 828/1607] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:04.266298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:04.269455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:04.277533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.278044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.278478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.279176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.279628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.280161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.294607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:04.296901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:04.304208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.304703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.305142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.305892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.306496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.306787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.314519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a075b509-c4af-4e48-8dc1-be713cba83d7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053450 Sep 06 12:02:04.315614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 780/1608] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:04.340505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29132441-278a-42fc-981d-7851f35b0f77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049945 Sep 06 12:02:04.341143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 829/1609] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:04.975391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:04.977736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:04.983780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.984269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.984709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.985405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.985519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:04.985894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.986337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.987732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:04.994331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.994829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.995273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:04.995978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:04.996437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:04.996872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:05.016370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e2d853af-217f-4efc-aa7e-44edbe592ed3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 06 12:02:05.016931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 781/1610] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:05.029491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c091da39-8f8b-463d-a414-bce4f869ee14 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Sep 06 12:02:05.030091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 830/1611] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:05.327592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:05.329791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:05.337384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:05.337904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:05.338344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:05.339039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:05.339486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:05.339910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:05.352610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:05.354848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:05.358055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:05.361002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:05.361668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:05.362134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:05.362845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:05.363302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:05.363734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:05.371954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3839793f-5513-4a82-82b2-bb42596020ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Sep 06 12:02:05.372537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 782/1612] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:05.396385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7b5bc7c6-93ae-4a5e-a58a-6b063cd03a89 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047741 Sep 06 12:02:05.396952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 831/1613] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:06.030066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:06.032290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:06.039147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.039633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.040068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.040803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.041251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.041716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.042522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:06.044727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:06.051569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.052058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.052501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.053209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.053705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.054144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.074663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f13989ef-c63a-4fd8-aa7d-d63e597e00c8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048679 Sep 06 12:02:06.075870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 783/1614] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:06.086704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e6303e2-f5f0-4a66-a4db-8f828fdd9a40 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Sep 06 12:02:06.087292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 832/1615] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:06.384867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:06.386975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:06.394351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.394837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.395276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.395967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.396421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.396847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.409419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:06.411703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:06.417627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.418138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.418571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.419322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:06.419776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:06.420198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:06.427970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f05dcae-ae4b-4576-92e9-c68e2e6df415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Sep 06 12:02:06.428833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 784/1616] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:06.454508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c320be6d-da0a-4338-abdb-4669aad2ad1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049919 Sep 06 12:02:06.455181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 833/1617] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:07.086864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:07.089034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:07.095079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.095564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.097196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.097934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.098396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.098820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.099408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:07.101554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:07.107920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.108396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.108828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.109520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.109991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.110411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.131341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac1c92ec-9b39-4e66-951b-1387355fb84c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048465 Sep 06 12:02:07.131920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 785/1618] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:07.140230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eef24058-71f5-414a-922c-1b38dbdd2af5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Sep 06 12:02:07.140785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 834/1619] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:07.443019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:07.445148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:07.451572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.452077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.452506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.453185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.453629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.454075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.467235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:07.469422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:07.476509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.477000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.477437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.478198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:07.478657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:07.479086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:07.484274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-87f979d7-7f8f-4356-a922-538875d7e11a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Sep 06 12:02:07.484846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 786/1620] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:07.509377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dfc59d91-fe84-47bc-824d-c22e88ddce8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045957 Sep 06 12:02:07.509903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 835/1621] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:08.144358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:08.146578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:08.152295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:08.152652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.153140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.153578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.154304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.154473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:08.154759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.155188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.161544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.162102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.162545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.163241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.163698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.164148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.185916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-212b0faa-d2b5-4810-9e81-0992cc6e9e42 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Sep 06 12:02:08.186491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 787/1622] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:08.197152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-535a37de-9831-4472-8b81-54534ce81848 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048781 Sep 06 12:02:08.197736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 836/1623] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:08.496656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:08.498872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:08.511319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.511319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.511319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.511319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.512522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.512522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.524509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:08.526710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:08.532674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.533735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.534928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.535634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:08.536321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:08.536752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:08.540380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-08535af2-82e2-428f-b02e-c7edef605414 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047684 Sep 06 12:02:08.540963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 788/1624] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:08.568114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a1fded5e-0b19-42fb-b5c3-cafccadbf1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050195 Sep 06 12:02:08.572796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 837/1625] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:09.199383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:09.201511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:09.208371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.208866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.209368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.210472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.210670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.211043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.212998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:09.215246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:09.221685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.222182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.222625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.223331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.223791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.224261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.241240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a9e6fd6f-0b36-42a1-a9e9-aba5e296352a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045973 Sep 06 12:02:09.241849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 789/1626] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:09.254712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1e428f9-43b3-45db-880f-b3fa26cb9fcf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050301 Sep 06 12:02:09.255285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 838/1627] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:09.553664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:09.555812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:09.561739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.562224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.562678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.563369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.563817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.564236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.580778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:09.582970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:09.588861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.589348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.589845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.590549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:09.591010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:09.591437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:09.595141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:09.596150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-af632c72-e7ca-4bb8-8989-6ebd759decca tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047458 Sep 06 12:02:09.596967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 790/1628] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:09.623876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-df8bc105-7ed2-46c3-99d2-183032c213ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047161 Sep 06 12:02:09.624448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 839/1629] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:10.254025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:10.256227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:10.263044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.263621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.264067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.264805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.265264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.265923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.267455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:10.270532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:10.276942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.277422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.277881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.278598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.279050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.279469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.297816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ce26cb64-a7fc-4efe-9ea8-5b74e1c8b3b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Sep 06 12:02:10.298395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 791/1630] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:10.309834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1bbd28ce-1424-40d1-a422-3d265986fcb0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046208 Sep 06 12:02:10.310390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 840/1631] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:10.608738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:10.610848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:10.619361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.620100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.620758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.621841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.622550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.623244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.636665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:10.638900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:10.646587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.646587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.646903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.647595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:10.648051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:10.648479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:10.666438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2fd92a00-d665-4fa8-bbf2-884f115b2ac2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061384 Sep 06 12:02:10.667292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 792/1632] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:10.679453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-098a4480-84fc-4943-9ec7-d58062ad38fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046860 Sep 06 12:02:10.680043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 841/1633] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:11.310517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:11.312677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:11.319499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.319983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.320421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.321119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.321581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.322032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.322699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:11.324837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:11.332019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.332517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.332958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.333714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.334179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.334609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.353217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-70b5c70a-e733-4d86-a568-44097fddd79d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Sep 06 12:02:11.353832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 793/1634] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:11.365837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9bdce0ac-d341-4781-8bed-f615707b5d80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047275 Sep 06 12:02:11.366386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 842/1635] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:11.680815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:11.683093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:11.689023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.689743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.690772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.691477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.691935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.692357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.692477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:11.694558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:11.700849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.701367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.701871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.702579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:11.703036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:11.703462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:11.724249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-23d497f3-03fc-47da-b1ac-8197c2f8d1de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Sep 06 12:02:11.724818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 794/1636] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:11.734653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1832e1a2-6111-4734-aba7-bcfffb4315fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046204 Sep 06 12:02:11.735214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 843/1637] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:12.365906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:12.368129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:12.375241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.375728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.376154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.376834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.377893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.378395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.378772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:12.380848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:12.387018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.387502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.387936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.388629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.389079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.389498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.410423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba3ce11e-cabf-4721-96b5-08b9935dea4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048642 Sep 06 12:02:12.411002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 795/1638] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:12.420310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-312f61a6-330e-407d-8e1a-a70322af9da7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046955 Sep 06 12:02:12.420868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 844/1639] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:12.736894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:12.739141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:12.745092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.745579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.746043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.746733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.747181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.747598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.748294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:12.750630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:12.757814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.758272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.758736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.759445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:12.760442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:12.761022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:12.779848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-016d3465-d8e7-46c7-b86d-c4999e224b63 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047349 Sep 06 12:02:12.780429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 796/1640] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:12.796542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f7c0cc47-8d7c-4f68-8737-497b2fe9fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053223 Sep 06 12:02:12.797103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 845/1641] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:13.423458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:13.425762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:13.432355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.432829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.433255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.433973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.434116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:13.434416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.434840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.436399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:13.443189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.443760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.444228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.444962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.445442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.445916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.467325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dccbc02c-5f51-439a-84cd-25b0471b14f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047685 Sep 06 12:02:13.467819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 797/1642] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:13.476628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1ef486f8-f53f-4893-aa40-25e9b34340bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Sep 06 12:02:13.477190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 846/1643] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:13.792661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:13.794786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:13.801141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.801626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.802096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.802797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.803287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.803714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.809973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:13.812092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:13.818119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.818618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.819024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.819708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:13.820154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:13.820572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:13.833430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d71d996a-33b4-44c4-9965-f8752f01b59b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 Sep 06 12:02:13.834098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 798/1644] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:13.851564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e0b46b8c-5f0b-48e9-95a1-a8dc0b141e96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045536 Sep 06 12:02:13.852123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 847/1645] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:14.480262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:14.482557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:14.489515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.489795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:14.490039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.490480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.491308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.491773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.492092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:14.492202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.496002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:14.500278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.500903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.501348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.502849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.503871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.504300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.523349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-050c7149-5ece-4f8d-bb76-771a3ff628cd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Sep 06 12:02:14.524114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 799/1646] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:14.535799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66e832fb-058d-449d-affa-2f4d32c6c91a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051063 Sep 06 12:02:14.536381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 848/1647] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:14.846478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:14.848519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:14.854532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.855018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.855444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.856121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.856569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.856982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.864772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:14.867085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:14.873364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.873909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.874348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.875052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:14.875513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:14.875931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:14.888754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-064fab79-ace6-40ce-a90a-d58d842f69b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Sep 06 12:02:14.889335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 800/1648] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:14.906322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49ac446a-f468-46bd-81a5-0e816bf6440d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046142 Sep 06 12:02:14.906885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 849/1649] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:15.536760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:15.539029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:15.546267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.546763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.547203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.547911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.548363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.548870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.550318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:15.552673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:15.559449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.560086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.560692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.561528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.562117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.562670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.583672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a374cf5c-aadb-438f-bfd0-50675167b29e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052020 Sep 06 12:02:15.587367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 801/1650] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:15.596370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-60183ecd-c82f-4391-97f0-d2ff73c91a02 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051243 Sep 06 12:02:15.597231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 850/1651] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:15.901219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:15.903413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:15.910504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.910997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.911543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.912132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.912579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.913000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.919501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:15.921677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:15.928298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.928792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.929240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.929975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:15.930433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:15.930860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:15.945668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e2380bf-0bff-465a-acc2-1e24e3e32660 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048639 Sep 06 12:02:15.946287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 802/1652] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:15.962785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf488f54-a8d7-4b3e-a9a6-3169a5a06135 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047218 Sep 06 12:02:15.963369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 851/1653] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:16.596632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:16.599455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:16.606276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.606764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.607204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.607907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.608272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:16.608391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.608775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.610467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:16.616768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.617253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.617712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.618409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.618885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.619308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.639276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4cc5ebbb-0fd2-483d-a2eb-aa0da1f8b87c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046771 Sep 06 12:02:16.639867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 803/1654] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:16.650657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f1c5310b-9fff-4066-af92-9414e7b434e2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Sep 06 12:02:16.651221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 852/1655] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:16.959166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:16.961385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:16.967400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.967886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.968327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.969021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.969489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.969925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.974969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:16.977247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:16.983103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.983580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.984012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:16.984697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:16.985363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:16.985829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:17.000685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b73aab8-c72a-44bd-9d31-bd02ec550786 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Sep 06 12:02:17.001246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 804/1656] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:17.016295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c2650e89-3f98-4623-944e-ca3ee629d308 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045331 Sep 06 12:02:17.016859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 853/1657] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:17.653169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:17.655262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:17.662502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:17.662689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:17.662994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:17.663436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:17.664137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:17.664593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:17.664914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:17.665024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:17.671616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:17.672110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:17.672587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:17.673298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:17.673837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:17.674377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:17.695606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1bef5f11-6987-4ab8-9538-781f4e8ba3f3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Sep 06 12:02:17.696178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 805/1658] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:17.704538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-33e991c5-f6bf-4edc-a7c6-71b3338a1763 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Sep 06 12:02:17.705728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 854/1659] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:18.013220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:18.015426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:18.022565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.023055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.023496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.024204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.024662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.025091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.030646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:18.032782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:18.039297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.039787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.040242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.040923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.041380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.041835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.055501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bce96d61-768d-4187-a532-4b73c69c0c8d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Sep 06 12:02:18.056084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 806/1660] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:18.069321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:18.075041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-94bc6d4d-48cc-4e26-98b0-166c6041ce09 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049468 Sep 06 12:02:18.075609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 855/1661] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:18.708107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:18.710924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:18.716979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:18.717450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.717971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.718416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.719112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:18.719238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.719593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.720022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.725854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.726345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.726784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.727482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:18.727939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:18.728365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:18.749413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b7e2d36-0ceb-43a0-9655-0a0dcf8d41e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Sep 06 12:02:18.750222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 807/1662] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:18.758922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7669907c-299a-48c3-97b2-92c16498e47f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Sep 06 12:02:18.759483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 856/1663] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:19.068868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:19.071003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:19.076944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.077419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.077891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.078580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.079028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.079445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.086692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:19.088840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:19.094947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.095437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.095878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.096674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.097041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.097468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.108905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eea8b37d-1eb1-41f1-8ede-147772f9322e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Sep 06 12:02:19.109709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 808/1664] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:19.128227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-345d7150-b092-446d-b5d4-b29af93bbddb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045427 Sep 06 12:02:19.128794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 857/1665] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:19.764478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:19.766776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:19.772003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:19.774121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:19.774311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.774802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.775238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.775941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.776399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.776831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.780399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.780882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.781313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.782026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:19.782470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:19.782889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:19.807839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f973786a-0ef8-4579-a726-55cdb14a7713 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047282 Sep 06 12:02:19.808646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 809/1666] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:19.812934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90aae64e-4597-47f3-888c-e55f253e22be tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Sep 06 12:02:19.813493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 858/1667] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:20.122618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:20.124752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:20.131428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.131917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.132359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.133057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.133512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.133967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.140770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:20.144186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:20.151483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.152100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.152572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.153315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.153955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.154387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.165774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0bc7fb47-1add-421b-9988-6f7a8f736797 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Sep 06 12:02:20.166477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 810/1668] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:20.189086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c697fd90-76e6-42eb-9934-94c7432cf5ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052433 Sep 06 12:02:20.190427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 859/1669] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:20.821240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:20.823533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:20.825721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:20.827895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:20.830944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.831645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.831930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.832551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.833023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.833438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.835619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.836135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.836571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.837352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:20.837793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:20.838251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:20.863753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-775e8ae1-f825-4bb2-9674-12fb092082de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Sep 06 12:02:20.864342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 811/1670] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:20.869537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-471bcfd0-fe42-4d51-98d1-5d5ba07b1cd1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047886 Sep 06 12:02:20.870175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 860/1671] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:21.179719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:21.182160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:21.188294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.188772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.189205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.189922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.190388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.191407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.203455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:21.205863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:21.218096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.218673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.219206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.220281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.220882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.221417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.223845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f500164c-5558-4cc5-974f-f60a0f9c9479 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048586 Sep 06 12:02:21.224461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 812/1672] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:21.257259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2cbb5561-f2b3-419b-b683-97753d776c5b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057986 Sep 06 12:02:21.257896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 861/1673] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:21.877606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:21.880114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:21.884076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:21.887285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:21.887678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.888215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.888729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.889509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.890024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.890518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.895711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.896216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.896659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.897400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:21.897980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:21.898416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:21.935026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae1e2a85-b2b1-4cfb-a45c-dd2bfe3b0658 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062310 Sep 06 12:02:21.935651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 813/1674] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:21.944001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2de4ba76-8368-4d16-a87d-f66f274b3615 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065162 Sep 06 12:02:21.944707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 862/1675] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:22.236866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:22.239735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:22.246009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.246498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.246942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.247652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.248440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.248879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.273605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:22.276034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:22.282626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.283116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.283790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.285087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.285764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.286192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.287119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-341819c3-eb9f-4984-b966-f8fcd823758f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054327 Sep 06 12:02:22.287908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 814/1676] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:22.327619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c1143d54-7956-4dc3-8f80-8b9deaba75af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060013 Sep 06 12:02:22.328234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 863/1677] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:22.947261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:22.949422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:22.955929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.956438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.957523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.958256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.958714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.958837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:22.959140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.960947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:22.967395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.967874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.968308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.969003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:22.969455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:22.969931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:22.986401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:22.993249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8a7d5b1c-2c40-49c2-a9ed-860439e8e431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050112 Sep 06 12:02:22.998168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 815/1678] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:23.001358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ec7655a5-0fc8-4fe5-96ea-b1b2b6ba9527 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Sep 06 12:02:23.001953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 864/1679] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:23.300813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:23.303028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:23.309686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:23.310242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:23.310715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:23.311412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:23.311872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:23.312299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:23.340296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:23.341812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0b1a392-ffb8-4451-960a-04b4486e5d64 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045257 Sep 06 12:02:23.342383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 816/1680] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:23.342582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:23.349810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:23.350302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:23.350738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:23.351444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:23.351897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:23.352325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:23.383126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2b2ded1d-2182-4743-9c44-12e0872e302e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046796 Sep 06 12:02:23.383688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 865/1681] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:24.006499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:24.008762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:24.014003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:24.015503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.016002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.016157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:24.016443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.017153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.017637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.018065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.023923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.024418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.024857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.025559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.026039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.026466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.048931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e4329f6-71b1-4266-b2e7-ed4bd68af69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047343 Sep 06 12:02:24.049508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 817/1682] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:24.057872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4eb5695a-ccfa-49f7-8c5c-3a32b079b780 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Sep 06 12:02:24.058431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 866/1683] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:24.354523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:24.356620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:24.363113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.363594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.364062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.364749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.365368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.365630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.395753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fd6298d4-1010-450d-b3a6-973a20c13a0f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Sep 06 12:02:24.396008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:24.396633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 818/1684] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:24.398444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:24.400360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:24.405788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.406280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.406751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.407458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:24.407916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:24.408347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:24.438789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f6fd582-a698-45bc-8441-0f76ad45af51 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047004 Sep 06 12:02:24.439347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 867/1685] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:25.062408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:25.064605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:25.070232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:25.071209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.071703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.072137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.072427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:25.072847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.073298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.073757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.079183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.079669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.080111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.080892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.081893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.082367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.105440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c97c3a1-f2c9-40fc-9a97-f7e6d6fdd6ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Sep 06 12:02:25.106085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 819/1686] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:25.114505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c095505a-2df4-4d21-a338-f619d12fca61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048354 Sep 06 12:02:25.115079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 868/1687] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:25.407800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:25.409963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:25.415806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.416283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.416721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.417396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.417869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.418288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.447357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ec6978e7-5dcd-47c6-a0ab-ddf40c704f5c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 Sep 06 12:02:25.447912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 820/1688] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:25.451613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:25.453778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:25.460511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.460997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.461439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.462165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:25.462624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:25.463050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:25.492296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d05bdf12-0f10-44f7-b574-f01e4efd72e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044685 Sep 06 12:02:25.492858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 869/1689] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:26.118323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:26.120603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:26.126308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:26.127651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.128264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.128859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.129065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:26.129554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.130134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.130464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.135663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.136143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.136576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.137271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.137751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.138205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.161889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e145d1b-c320-4654-a378-0b15dfef197a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047572 Sep 06 12:02:26.162459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 821/1690] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:26.169934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-37c54ae9-f2d5-4aba-83f3-f97d9aa85478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047497 Sep 06 12:02:26.170526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 870/1691] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:26.460386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:26.462626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:26.468646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.469132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.469573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.470300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.470760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.471191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.501337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5008dbc7-fa26-4274-866d-fe81b8d30c22 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Sep 06 12:02:26.502022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 822/1692] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:26.504716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:26.506896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:26.512964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.513434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.513905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.514596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:26.515042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:26.515458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:26.545923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3f6fe5f-dc6b-45d6-8b81-2b6001b89f7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045496 Sep 06 12:02:26.546477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 871/1693] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:27.173951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:27.176167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:27.182031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:27.182674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.183154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.183585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.184269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.184382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:27.184716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.185131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.190487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.190981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.191439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.192139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.192573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.192999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.211820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:27.217406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02eafbfe-33dc-4e4a-91f7-7654982174cf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Sep 06 12:02:27.222031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 823/1694] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:27.226092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a3dfccc4-c86c-4459-b2bb-001111ed6a9f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047961 Sep 06 12:02:27.226707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 872/1695] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:27.513605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:27.515748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:27.522715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.523203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.523644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.524338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.524796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.525224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.555680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d3bf8b1-c6da-4827-9903-87b33aeb1a92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Sep 06 12:02:27.556248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 824/1696] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:27.559490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:27.561727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:27.569025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.569503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.569974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.570669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:27.571116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:27.571534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:27.604825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5bc0c9b6-588e-44cd-8afc-f296783aa54d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049341 Sep 06 12:02:27.605449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 873/1697] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:28.229956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:28.232100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:28.239359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:28.239849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.240337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.240772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.241499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.241615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:28.241997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.242652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.247916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.248412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.248884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.249621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.250104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.250605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.278133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a82a7bec-478a-4cdb-be6b-7b942fa99c20 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052101 Sep 06 12:02:28.278713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 825/1698] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:28.281880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50d6bf3d-06a9-42a3-9795-a7e0c82984b8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Sep 06 12:02:28.282606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 874/1699] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:28.568458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:28.570660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:28.576637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.577126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.577576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.578358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.578811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.579237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.610491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5a0c6c81-7ab5-4a06-8803-97101659ad28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Sep 06 12:02:28.611061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 826/1700] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:28.617413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:28.619590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:28.626037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.626528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.626965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.627675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:28.628155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:28.628616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:28.659632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ffa45bd7-2b12-4566-a88a-b74e78a2d89b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046283 Sep 06 12:02:28.660751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 875/1701] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:29.290966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:29.293236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:29.295684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:29.295957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:29.298900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:29.301401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.301946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.302381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.303668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.304141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.304559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.306235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.306760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.307166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.308009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.308612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.309042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.336971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-338739b2-2c1f-433b-b2e1-d72d7639f3ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Sep 06 12:02:29.337556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 827/1702] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:29.342307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8747fe7-4735-4f2c-96e9-0ded2d44668d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051699 Sep 06 12:02:29.342874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 876/1703] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:29.623580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:29.625920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:29.632527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.633015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.633457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.634262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.634832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.635151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.666585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-89d705e2-d2b0-4687-aa2b-319511476e40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047241 Sep 06 12:02:29.667162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 828/1704] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:29.674332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:29.677011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:29.687006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.687741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.688412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.689510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:29.690348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:29.691067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:29.737787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b022eb75-b434-4a02-8722-629f659e0788 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068340 Sep 06 12:02:29.738712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 877/1705] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:30.349771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:30.353180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:30.356037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:30.358385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:30.360007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.360347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.360785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.361481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.361960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.362381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.365325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.366533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.367072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.367963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.368427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.368854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.392513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a97d2bb-d9c5-4c03-89de-1c49e3e4004d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Sep 06 12:02:30.393086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 829/1706] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:30.399545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e11713f-3a4a-4e4b-9fbd-1adb5eb65478 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047345 Sep 06 12:02:30.400149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 878/1707] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:30.679197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:30.681429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:30.687542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.688028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.688469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.689166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.689626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.690088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.719050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ed7b0d5-278a-4b41-b7c5-ac12346a9ed1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Sep 06 12:02:30.719615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 830/1708] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:30.751662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:30.753896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:30.760333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.760822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.761262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.761986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:30.762446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:30.762877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:30.793959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4daf4864-58cb-47f7-bcf8-d621fd0ffd91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046190 Sep 06 12:02:30.794521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 879/1709] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:31.404885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:31.407100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:31.412075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:31.413954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.414447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.414893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.415603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.415779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:31.416060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.416489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.423301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.423824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.424325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.425078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.425667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.426137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.450340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a3e28f6-582a-4940-8c0e-1d8212f8a801 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049241 Sep 06 12:02:31.451128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 831/1710] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:31.459183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a207df1-03f3-4b72-84d3-a40fa9f5ec80 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Sep 06 12:02:31.460392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 880/1711] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:31.731992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:31.734217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:31.740218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.741252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.741845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.742544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.743004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.743434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.761447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:31.774646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aad36f01-31aa-4e12-bc8f-c134bba521de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046676 Sep 06 12:02:31.775216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 832/1712] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:31.807310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:31.809441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:31.816287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.816780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.817216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.817936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:31.818397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:31.819559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:31.849027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-723611d9-38f1-457d-aca0-5d6be5565c11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046413 Sep 06 12:02:31.849584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 881/1713] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:32.463601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:32.465772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:32.472013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:32.472304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.472792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.473247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.473958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.474262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:32.474412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.474836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.481604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.482193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.482759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.483456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.484022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.484482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.506254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc4c4bbc-cf4c-43f2-996e-fc53c7922348 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Sep 06 12:02:32.507094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 833/1714] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:32.515041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c20ed30c-5280-4ba7-b1e8-3c8729a070d5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 Sep 06 12:02:32.515596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 882/1715] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:32.787473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:32.789540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:32.795532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.796022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.796465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.797166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.797626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.798088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.827737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1810899-c329-48e5-841d-439cf7dddf92 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Sep 06 12:02:32.828304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 834/1716] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:32.862652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:32.864797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:32.872943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.873433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.873906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.874616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:32.875071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:32.876116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:32.906045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ad0600e2-0b05-4d0a-8b1d-f926831099f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047333 Sep 06 12:02:32.906610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 883/1717] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:33.519916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:33.522201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:33.527715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:33.528947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.529494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.529966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.530077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:33.530694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.531151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.531579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.535945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.536434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.536878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.538253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.538938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.539134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.565555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8f00b410-98b7-4231-8d11-6b65b5345c4d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050010 Sep 06 12:02:33.566163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 835/1718] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:33.572572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cfe2f084-e32f-42d0-b07e-7cdceb77bd13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048742 Sep 06 12:02:33.573134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 884/1719] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:33.841138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:33.843231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:33.849100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.849586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.850168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.851945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.852403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.852830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.882294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1d0fe01c-6fdc-41b8-aa1e-f72fa8967e5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Sep 06 12:02:33.882861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 836/1720] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:33.919441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:33.921598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:33.928114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.928905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.929266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.930013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:33.930478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:33.930908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:33.961166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0910a971-1442-4a3e-9806-4e04fb3d1173 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045733 Sep 06 12:02:33.961751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 885/1721] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:34.578208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:34.580479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:34.584268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:34.586819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:34.587357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.587855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.588445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.589335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.589831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.590356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.593037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.593526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.594009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.594709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.595175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.595602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.621488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-af30e7de-4091-4541-9702-1859773ae2ec tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Sep 06 12:02:34.622106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 837/1722] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:34.625874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-379549d1-6145-45f6-8006-b7d9285da01b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Sep 06 12:02:34.626437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 886/1723] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:34.895412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:34.897817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:34.903750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.904239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.904680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.905370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.905857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.906284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.937104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c3743a2a-4dd9-4789-9326-eb32c4c19a4e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Sep 06 12:02:34.937689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 838/1724] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:34.974066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:34.976706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:34.983122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.983604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.984037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:34.984717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:34.985169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:34.985589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.015864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d693f8e2-1167-4904-95f5-81acc157ccb6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045697 Sep 06 12:02:35.016438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 887/1725] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:35.635677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:35.637804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:35.638328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:35.639842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:02:35.640056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:02:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:02:35.642486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:35.647958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:35.648319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:35.648456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:35.648884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:35.649077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.649349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.649597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:35.650087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:35.650269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:35.650522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.650691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:35.650954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.683304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cd05d33e-3d88-4251-9b23-7c29bc2b0ad1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052389 Sep 06 12:02:35.683894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 839/1726] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:35.687604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b4a4939a-bb62-4702-a363-4151a8d8fc7f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053190 Sep 06 12:02:35.688186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 888/1727] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:35.950018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:35.952213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:35.958344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:35.958833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:35.959792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.960492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:35.960945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:35.961375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:35.993873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-746e9976-7967-4de1-b556-717cd04272c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047782 Sep 06 12:02:35.994456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 840/1728] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:36.029516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:36.031713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:36.038899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:36.039383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:36.039820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:36.040548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:36.040985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:36.041408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:36.045164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:36.071754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1569b6ed-4246-42ae-9087-b64db9f6465a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046234 Sep 06 12:02:36.072318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 889/1729] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:36.697742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:36.699880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:36.700011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:36.702057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:36.706473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:36.706951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:36.707383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:36.707948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:36.708064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:36.708444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:36.708565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:36.708887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:36.708990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:36.710164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:36.710624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:36.711049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:36.741295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37eb8543-3b30-4bd8-89a3-8e3cb96ef9c4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048579 Sep 06 12:02:36.741891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 841/1730] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:36.743587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6eadee4e-25f3-448e-a1f7-dc59e824962b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047509 Sep 06 12:02:36.744197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 890/1731] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:37.007263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:37.009359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:37.015372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.015874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.016294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.016989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.017438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.017887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.048577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-30c3ffd1-1958-4a04-8562-59c2e9e9cbfa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045848 Sep 06 12:02:37.049139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 842/1732] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:37.085149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:37.087476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:37.093953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.094442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.094885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.095592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.096047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.096474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.126063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a87c389-cd3a-4197-9763-27fe894c1b50 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045672 Sep 06 12:02:37.126627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 891/1733] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:37.753688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:37.755022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:37.755816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:37.757766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:37.763044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.763520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.763690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.763952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.764178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.764619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.764735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.765074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.765345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:37.765494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.765841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:37.766272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:37.795205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4b1169b-be2b-40fa-a26e-175b8604806a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Sep 06 12:02:37.795767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 843/1734] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:37.795899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a2b7b7d-c06c-4998-880f-01a3bd41fc06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Sep 06 12:02:37.797693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 892/1735] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:38.061572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:38.063697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:38.069660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.070162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.070602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.071299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.071753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.072180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.102622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ea35ac0-5596-43bb-9f1a-12e2210cc017 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Sep 06 12:02:38.103181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 844/1736] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:38.138696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:38.140832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:38.147632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.148125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.148569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.149275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.149764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.150193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.180884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-496e8ca7-a3f4-4ae1-ac0a-d9d0c7f2a51f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046094 Sep 06 12:02:38.181484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 893/1737] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:38.808613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:38.809156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:38.810785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:38.811341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:38.816761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.817240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.817688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.817826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.818182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.818382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.818626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.819319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.819739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.820410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:38.820873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:38.821303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:38.849803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8542e163-901f-4a23-934f-fd14d8991c90 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Sep 06 12:02:38.854862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 894/1738] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:38.855014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-232f8d57-ca3d-4d0b-bdf2-e5b43c8dc4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047908 Sep 06 12:02:38.855014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 845/1739] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:39.116047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:39.118366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:39.124377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.124861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.125305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.126026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.126483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.126912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.156730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6726a83c-e198-46fc-a2dc-4a65fe620b66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Sep 06 12:02:39.157368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 895/1740] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:39.193666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:39.196457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:39.202548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.203028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.203459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.204135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.204582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.204998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.234776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b4d09e84-77f7-440a-afd7-c6ff16e4dce4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045197 Sep 06 12:02:39.235376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 846/1741] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:39.862258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:39.864254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:39.864431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:39.867163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:39.872097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.872593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.873037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.873359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.873769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.873894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.874234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.874355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.874660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.875011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:39.875486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:39.875904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:39.906510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-759226d0-7a00-43b8-80c4-16fcbafac76c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048341 Sep 06 12:02:39.906754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-935386dd-fd39-4273-8eb7-bff4a8a1d6ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 Sep 06 12:02:39.907363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 847/1742] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:39.907461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 896/1743] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:40.169948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:40.172088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:40.178857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.179359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.179867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.180588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.181136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.181560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.211010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-79957e9d-26fb-43df-9f58-aca5e6c4b687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Sep 06 12:02:40.211653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 848/1744] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:40.248007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:40.250230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:40.257527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.258152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.258510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.259349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.259979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.260422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.292980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9db6465b-810f-40b1-bdde-b0ece67d629a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049037 Sep 06 12:02:40.293551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 897/1745] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:40.918870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:40.919195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:40.921056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:40.921332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:40.927410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.927626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.927896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.928070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.929017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.929216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.929755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.930222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.930403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:40.930652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.930785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:40.932322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:40.935294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:40.963927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-054df422-f03b-4148-a11d-c29cdda242c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Sep 06 12:02:40.964530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 898/1746] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:40.964725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2180f0b0-0a37-4151-9b2a-6ece6fec71af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049685 Sep 06 12:02:40.965173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 849/1747] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:41.222856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:41.225122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:41.232395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.232872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.233307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.234033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.234488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.234911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.265609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aa6d2157-cad5-47d4-af4a-ef47e453551e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Sep 06 12:02:41.266259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 899/1748] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:41.305614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:41.307813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:41.314261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.314740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.315172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.315892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.316342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.316767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.347358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-27aba1ad-115c-4252-9d6f-ba010e2ab0b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046262 Sep 06 12:02:41.347919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 850/1749] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:41.976825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:41.977131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:41.979022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:41.979191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:41.985527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.985758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.986127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.986243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.986562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.986672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.987260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.987377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:41.987706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.987816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:41.988123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:41.988240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:42.020967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c57c0c95-e482-4ba3-8918-25b29e46812b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048169 Sep 06 12:02:42.021553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 851/1750] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:42.023097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d1fe0d9a-0eff-49a7-a761-f7128762784a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050388 Sep 06 12:02:42.023769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 900/1751] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:42.278537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:42.280691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:42.286661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:42.287165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:42.287625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:42.288852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:42.289305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:42.289765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:42.323246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e6422ebc-74da-488c-b5e5-3f6c3801e385 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048631 Sep 06 12:02:42.323951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 852/1752] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:42.361027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:42.363181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:42.370276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:42.370786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:42.371189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:42.371869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:42.372318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:42.372734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:42.402452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8b6c40f0-9712-40a1-ad05-1fea651c4fb0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045382 Sep 06 12:02:42.403012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 901/1753] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:43.033911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:43.035150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:43.036081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:43.037271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:43.043293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.043786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.044226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.044745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.044930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.045232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.045386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.045704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.045838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.046409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.046870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.047289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.076904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6fde8272-cd0c-402c-870e-6c688eee4a32 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046937 Sep 06 12:02:43.077702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 853/1754] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:43.079113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66b7833a-74a4-489e-a5d0-670d1b40bf6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047798 Sep 06 12:02:43.079801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 902/1755] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:43.336133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:43.338227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:43.344608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.345098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.345533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.346253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.346704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.347130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.377899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c39df18a-d3d7-4b20-b72b-2c3a8dd2c48f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045994 Sep 06 12:02:43.378469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 854/1756] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:43.416191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:43.418340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:43.424721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.425203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.425637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.426352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:43.426805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:43.427227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:43.458917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bd95e23f-6d62-4de7-b559-d8e27d28caeb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047840 Sep 06 12:02:43.460151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 903/1757] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:44.089885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:44.091654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:44.091963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:44.093960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:44.098268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.098761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.099204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.099904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.100032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.100419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.100605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.100885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.101675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.102144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.102636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.105958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.134125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-353c89f6-aafe-4779-a946-0c292ed88c47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046387 Sep 06 12:02:44.134704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 904/1758] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:44.137589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71274119-70bb-4fd1-aee8-2d629b500c62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052068 Sep 06 12:02:44.138189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 855/1759] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:44.390693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:44.392728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:44.399184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.399674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.400106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.400799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.401247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.401688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.427127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:44.432948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f923531a-dcf9-418f-abe9-f0532f87f619 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046290 Sep 06 12:02:44.433520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 905/1760] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:44.471535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:44.473782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:44.480206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.480728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.481167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.481904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:44.482362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:44.482786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:44.513819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fbdaa221-2ee5-429a-94ba-b453afd9f71b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046219 Sep 06 12:02:44.514398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 856/1761] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:45.148540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:45.150883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:45.152164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:45.154341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:45.156960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.157449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.157915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.158615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.159070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.159495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.160364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.160857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.161298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.162026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.163105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.163739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.191129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-67e41078-4c3c-4f1c-8999-74b06e80d95e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Sep 06 12:02:45.191707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 906/1762] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:45.192840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-915ee9c5-8624-4c04-bb19-0b97b56d4cca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045531 Sep 06 12:02:45.193410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 857/1763] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:45.447113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:45.449290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:45.455681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.456160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.456592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.457278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.457757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.458182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.488120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0137aa90-2103-4493-ada0-f4a4b03cc1b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Sep 06 12:02:45.488670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 907/1764] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:45.527451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:45.529632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:45.535941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.536435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.536850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.537548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:45.538061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:45.538481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:45.567008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d835213f-987e-4736-b60d-7ab37e6ad727 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043570 Sep 06 12:02:45.567559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 858/1765] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:46.204193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:46.204751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:46.206383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:46.206906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:46.213192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.213402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.213695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.213819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.214133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.214247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.214833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.214945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.215291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.215402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.215720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.215825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.246649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf6ce5d7-68f1-4c84-8132-852c3bb4a11f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Sep 06 12:02:46.247039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eb315f5a-b940-4308-92bc-40a5f0c94471 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Sep 06 12:02:46.247523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 908/1766] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:46.253885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 859/1767] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:46.501619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:46.503825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:46.510849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.511333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.511766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.512535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.513199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.513626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.544607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed60194f-0e68-461d-8f76-3b3728271d8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046970 Sep 06 12:02:46.545170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 909/1768] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:46.579953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:46.582140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:46.589019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.589523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.589989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.590666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:46.591106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:46.591521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:46.620991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-80fb13b1-d0e8-42a6-84ed-18ee264d26ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045027 Sep 06 12:02:46.621542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 860/1769] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:47.259707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:47.262032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:47.264107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:47.267373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:47.268076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.268560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.268992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.269958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.270402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.270849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.275954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.276527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.277041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.277852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.278386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.278886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.302954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a147a2b5-cfe6-456c-adc2-c0ba7ad1fca4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047677 Sep 06 12:02:47.303539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 910/1770] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:47.311191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f45df08b-d80f-4bb5-94a3-c387e539e548 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053196 Sep 06 12:02:47.311782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 861/1771] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:47.557345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:47.559432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:47.565855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.566340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.566775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.567468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.567921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.568351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.598324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8d8fb564-cdae-41e1-a118-9df1b6235912 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Sep 06 12:02:47.598892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 911/1772] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:47.634435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:47.636613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:47.643114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.643604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.644034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.644980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:47.645431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:47.645885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:47.675876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cb225a53-5bb6-4bad-84ab-59f2566d97de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046167 Sep 06 12:02:47.676428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 862/1773] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:48.316084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:48.318309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:48.323519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:48.324628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.325114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.325551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.325721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:48.326277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.326734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.327159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.331628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.332118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.332559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.333255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.333741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.334168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.358463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4a329e66-89d7-4725-949c-3f69ed77ba2e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046284 Sep 06 12:02:48.359045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 912/1774] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:48.364700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e1e14a4-8bda-4a0b-9479-b58f7b9bbb7b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Sep 06 12:02:48.365269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 863/1775] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:48.611023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:48.613142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:48.620284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.620763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.621197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.621917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.622370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.622790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.653797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0b1ad1bf-9728-4171-9712-1a88b7ab8e76 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046847 Sep 06 12:02:48.654363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 913/1776] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:48.688739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:48.690952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:48.697337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.697857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.698293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.698982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:48.699438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:48.699856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:48.729611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-104e4e31-b4b0-4f0d-80d9-1496e1129485 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044814 Sep 06 12:02:48.730194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 864/1777] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:49.371267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:49.373415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:49.377821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:49.379538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.379945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:49.380064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.380454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.381158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.381619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.382072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.386407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.386901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.387345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.388045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.388501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.388926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.413501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc07ca7b-69c4-4262-8867-13b167675e60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Sep 06 12:02:49.414187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 914/1778] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:49.418881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:49.420419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81ee9c14-2cc9-4862-9a7e-840022183c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Sep 06 12:02:49.420994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 865/1779] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:49.666540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:49.668678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:49.675162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.675650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.676087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.676777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.677233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.677665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.706536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09847a85-5e15-41db-a282-8b3f3c886424 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Sep 06 12:02:49.707093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 915/1780] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:49.742533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:49.744702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:49.751176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.751663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.752100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.752791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:49.753242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:49.753682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:49.783222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a8998a83-bbf2-4ce4-ac6f-cc47b9beb8d9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044935 Sep 06 12:02:49.783774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 866/1781] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:50.427129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:50.429275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:50.434147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:50.435993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.436275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:50.436488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.436935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.437639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.438129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.438558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.442193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.442683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.443160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.443866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.444326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.444752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.468980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-45a90033-3e93-4d75-aa31-45971f991138 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Sep 06 12:02:50.469558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 916/1782] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:50.475456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5d0c9e40-0e31-4b14-b759-1435a3b19765 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Sep 06 12:02:50.476021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 867/1783] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:50.720003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:50.722208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:50.724520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:50.732056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.732774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.733446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.734454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.734907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.735329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.766365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a3fa94f-d670-42bd-a6eb-ca43b5263aff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050413 Sep 06 12:02:50.766930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 917/1784] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:50.796694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:50.798882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:50.806104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.806593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.807032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.807729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:50.808191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:50.808618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:50.839754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d3182d51-f508-4843-b5c2-0c13972d5ff0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047142 Sep 06 12:02:50.840314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 868/1785] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:02:51.481874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:51.484020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:51.490187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.490675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.491113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.491808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.492489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.493036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.527386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9c569b3a-0b92-43b5-94b5-06bc09ad2c03 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049438 Sep 06 12:02:51.528045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 918/1786] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:51.554653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:51.556795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:51.562699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.563187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.563630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.564319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.564772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.565205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.595291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-362794ef-d790-4e39-ae34-e384e7573829 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111071 Sep 06 12:02:51.595849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 869/1787] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:02:51.778827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:51.780891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:51.787540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.788025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.788458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.789281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.789751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.790173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.819215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-726d2fa0-9568-4c32-b209-73c61f735ea7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 06 12:02:51.819756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 919/1788] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:51.852153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:51.854319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:51.860626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.861133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.861555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.862278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:51.862734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:51.863161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:51.893905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-639c756e-1948-4c47-81cb-21d268b904e7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045771 Sep 06 12:02:51.894467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 870/1789] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:52.541445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:52.543617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:52.549677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.550201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.550638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.551323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.551783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.552206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.581892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-da940788-2f0d-4eb2-830b-c250a58941b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Sep 06 12:02:52.582445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 920/1790] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:52.608957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:52.611265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:52.623590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.624084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.624522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.625229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.625705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.626128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.658303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02a84c09-ddaf-46da-a572-5c7eb76b242a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053302 Sep 06 12:02:52.658872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 871/1791] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:52.831669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:52.833762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:52.840327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.840798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.841226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.841934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.842383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.842801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.872243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-849b0709-4c36-4669-8440-ed29dfd2daa5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Sep 06 12:02:52.872803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 921/1792] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:52.907295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:52.909478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:52.916462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.916947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.917383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.918120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:52.918574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:52.918999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:52.966106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a374d29a-6981-4633-aad0-507c1eca002e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061708 Sep 06 12:02:52.968009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 872/1793] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:53.595094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:53.597248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:53.603873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.604370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.604812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.605520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.606022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.606570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.625240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:53.638862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ad611c1-d3dd-45a1-8b89-8a2d4f708d74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 Sep 06 12:02:53.639450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 922/1794] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:53.670968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:53.673179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:53.679093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.679665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.680193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.680708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.681158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.681577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.711741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3b342553-d6a2-4255-86ce-3190c3155d6f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Sep 06 12:02:53.713134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 873/1795] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:53.884636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:53.886683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:53.892961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.893451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.893903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.894827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.895280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.895699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.925812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c459045c-7777-4cdf-bd58-e445d7484496 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045874 Sep 06 12:02:53.926371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 923/1796] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:53.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:53.982449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:53.988971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.989459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.989945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:53.990643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:53.991101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:53.991530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.022493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c9cf98d-55ce-42c7-a65f-db3d0e0f6e4a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046426 Sep 06 12:02:54.023096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 874/1797] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:54.651735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:54.653831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:54.659811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:54.660294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:54.660736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.661426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:54.661907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:54.662334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.692247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8ec5ab9a-b9b8-4409-96bd-c620dc4c777b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Sep 06 12:02:54.692801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 924/1798] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:54.724961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:54.728174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:54.734171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:54.734648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:54.735083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.735772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:54.736228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:54.736646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.766280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b2f1c198-c5db-4104-b1c9-609da19bb852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Sep 06 12:02:54.766835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 875/1799] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:54.939467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:54.941622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:54.949188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:54.949693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:54.950136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.950836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:54.951291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:54.951713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:54.981818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d5e2fbd-aa0d-4645-baaf-5a78bd9ae585 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046308 Sep 06 12:02:54.982384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 925/1800] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:55.035329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:55.037465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:55.044614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:55.045139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:55.045577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:55.046323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:55.046778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:55.047201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:55.077167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-94fcf9e4-5d1e-445e-9326-8210b5312a6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045915 Sep 06 12:02:55.077739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 876/1801] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:55.704996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:55.707223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:55.713914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:55.714403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:55.714850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:55.715575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:55.716041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:55.716467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:55.746845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3c9b46a-7dd0-4586-ad2a-bc0f61fbd193 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Sep 06 12:02:55.747414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 926/1802] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:55.779509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:55.781685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:55.783821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:55.789900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:55.790391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:55.790829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:55.791525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:55.791986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:55.792408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:55.822680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-97e04b39-c7d2-4ea7-b767-76409b44800f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Sep 06 12:02:55.823252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 877/1803] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:55.995105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:55.997179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:56.003759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.004243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.004677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.005362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.005858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.006282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.038110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-08d3c161-26e9-4caa-8663-2cec7273a83d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047675 Sep 06 12:02:56.038713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 927/1804] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:56.090494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:56.092636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:56.099732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.100221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.100663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.101393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.101988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.102417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.148850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09fec2dc-e51a-4ff8-968c-f05dbaa47aa4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062217 Sep 06 12:02:56.149774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 878/1805] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:56.760340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:56.762522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:56.768528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.769006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.769451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.770491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.770956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.771384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.801245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c114093e-9bca-4d12-8f67-af5f6a93bb54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Sep 06 12:02:56.801834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 928/1806] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:56.837029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:56.839241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:56.845199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.845711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.846157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.846853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:56.847311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:56.847733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:56.877040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-609e6429-e0f9-43f2-b99b-351eae6d73a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Sep 06 12:02:56.877610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 879/1807] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:57.050583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:57.052632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:57.061414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.061945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.062377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.063064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.063512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.063932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.093252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-041dfe7f-4780-4766-9c1c-593243a7d6a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046757 Sep 06 12:02:57.093856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 929/1808] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:57.161668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:57.163822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:57.170177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.170654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.171087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.171773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.172221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.172634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.203197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ee55a7ce-9c74-416c-9e8d-09948d3d555e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045465 Sep 06 12:02:57.203746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 880/1809] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:57.814395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:57.816492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:57.823219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.823712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.824152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.824874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.825363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.825839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.856293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a28dd5d-a18b-4722-ad2a-f06fb79561d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Sep 06 12:02:57.856858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 930/1810] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:57.889455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:57.891740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:57.897978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.898466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.899427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.900166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:57.900616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:57.901046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:57.930951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4711de5e-30bd-4a74-a0cf-ef0ee0c0794e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Sep 06 12:02:57.931513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 881/1811] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:58.106056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:58.108158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:58.114348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.114841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.115287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.115984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.116444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.116870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.146601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92d3bedf-f53b-4d9b-bf32-624587e995f1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Sep 06 12:02:58.147163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 931/1812] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:58.216588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:58.218850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:58.225256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.225769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.226199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.226883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.227331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.227749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.245593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:58.259481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c1d781d-e17f-4a3e-bd18-aeaa70dae691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046743 Sep 06 12:02:58.260162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 882/1813] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:58.870004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:58.872530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:58.879014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.879504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.879941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.880648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.881422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.881537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.911692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb47af24-36af-40cb-9f0d-336b09cfd909 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Sep 06 12:02:58.912273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 932/1814] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:58.943268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:58.945418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:58.951363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.951841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.952273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.952955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:58.953407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:58.953854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:58.984051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6a5bc732-55a6-4973-a034-b507eb137546 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Sep 06 12:02:58.984620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 883/1815] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:59.159173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:59.161323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:59.168108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:59.168595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:59.169036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:59.169836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:59.170296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:59.170727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:59.200637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6ec7ffe6-1351-4b25-b14a-eab91b2552ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Sep 06 12:02:59.201204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 933/1816] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:59.272464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:59.275345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:59.281783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:59.282269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:59.282704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:59.283394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:59.283853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:59.284278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:59.314033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-36d6da78-2f51-4e75-ab41-6ef561bbe652 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045755 Sep 06 12:02:59.314589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 884/1817] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:02:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:02:59.925103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:59.927312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:02:59.934541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:59.935026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:59.935465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:59.936165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:02:59.936619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:02:59.937043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:02:59.966939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb13c54a-a92f-439b-8edc-511a6f2c42ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Sep 06 12:02:59.967500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 934/1818] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:02:59.997178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:02:59.999337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:00.005399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.005915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.006348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.007033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.007478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.007897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.037973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-10df2d4d-86ca-4375-af75-23d92662ba67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045520 Sep 06 12:03:00.038536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 885/1819] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:02:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:00.213211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:00.215363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:00.225257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.226187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.226978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.228241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.229068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.229910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.262242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa9f30b3-e419-4fd2-9ba2-35f0138564af tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053494 Sep 06 12:03:00.262817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 935/1820] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:00.326834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:00.329059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:00.335539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.336023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.336506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.337218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.337694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.338127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.369555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ecd7993-8cda-4c4e-adda-e6665da7908a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046774 Sep 06 12:03:00.370146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 886/1821] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:00.980469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:00.982636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:00.989003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.989484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.989957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:00.990652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:00.991107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:00.991533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.021921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-64040eac-0bf6-4989-a15d-9606fb9c62e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Sep 06 12:03:01.022485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 936/1822] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:01.050685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:01.052859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:01.059293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:01.059775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:01.060211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.060905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:01.061351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:01.061798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.092051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b1a14f5-ecba-4347-9ae9-41ef5991e79f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Sep 06 12:03:01.092617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 887/1823] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:01.275378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:01.277526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:01.283465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:01.283945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:01.284376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.285059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:01.285505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:01.285951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.314890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf8a99b5-a228-41b6-8d25-f185d8118680 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Sep 06 12:03:01.315455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 937/1824] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:01.381860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:01.385057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:01.391448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:01.391932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:01.392367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.393055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:01.393507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:01.393956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:01.424761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1ced2d0-d8f9-4361-85a7-9d6db1f291ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046903 Sep 06 12:03:01.425317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 888/1825] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:02.035458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:02.037575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:02.044725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.045202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.045629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.046334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.046782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.047197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.077387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ffd2e986-8447-4f4a-8128-52ee35eed3e0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 Sep 06 12:03:02.077979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 938/1826] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:02.104778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:02.107031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:02.112980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.113463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.113937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.114629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.115090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.115517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.146113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a03363f-a2fe-4142-a00e-cb4ea4df7b98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Sep 06 12:03:02.146660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 889/1827] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:02.327678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:02.329781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:02.335979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.337066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.337546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.338428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.338887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.339315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.343136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:02.370545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1df161aa-a903-47d8-a4d0-a19583ca84f4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046953 Sep 06 12:03:02.372189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 939/1828] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:02.437601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:02.439794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:02.446148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.446626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.447056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.447738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:02.448221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:02.448644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:02.479173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-29036eb7-6560-4d9c-83b1-c38928482d53 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045517 Sep 06 12:03:02.479735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 890/1829] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:03.093874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:03.097298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:03.107687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.108201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.108649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.109359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.109874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.110339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.143010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-939684f3-8b84-4b23-b1e1-b3d25b93084b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056591 Sep 06 12:03:03.143588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 940/1830] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:03.159860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:03.162110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:03.169045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.169534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.170010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.170709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.171192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.171591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.203376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a195394a-c4a1-4d7e-b964-503af34a8df9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047724 Sep 06 12:03:03.203968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 891/1831] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:03.384800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:03.386880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:03.392769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.393249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.393712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.394395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.395220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.395614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.424349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99cdf648-950a-42af-a481-72ef4117c3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Sep 06 12:03:03.424907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 941/1832] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:03.491886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:03.494873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:03.501872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.502363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.502802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.503502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:03.503961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:03.504388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:03.535103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7235946-da17-4244-ab9a-d9e0ef39b60b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047288 Sep 06 12:03:03.535667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 892/1833] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:04.156785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:04.159094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:04.166364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.166927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.167435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.168787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.168787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.169168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.200439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a368559c-16d7-4c4a-8418-a760c70b8800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047546 Sep 06 12:03:04.201001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 942/1834] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:04.216953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:04.219413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:04.225483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.226024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.226464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.227810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.228561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.229084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.262979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74a74680-8e0d-4418-a063-0429b937cb96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050088 Sep 06 12:03:04.263568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 893/1835] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:04.436795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:04.439012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:04.445551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.446363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.446808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.447501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.447970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.448394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.478042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5e47c9e7-ff42-4d49-aa54-eed2fa104035 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 06 12:03:04.478600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 943/1836] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:04.548594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:04.550825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:04.557916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.558448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.558886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.559578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:04.560049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:04.560636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:04.592199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-db54e6c0-f6ea-4247-b3cc-94fbdfd7e573 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047884 Sep 06 12:03:04.593134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 894/1837] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:05.213612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:05.215965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:05.222697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.223186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.223629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.224331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.224789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.225218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.256827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7e6c2f8f-5812-46a1-a13e-7289a7220ffa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047418 Sep 06 12:03:05.257405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 944/1838] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:05.276521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:05.279049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:05.285605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.286141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.286585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.287289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.287747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.288178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.321359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ca65e955-815d-4f57-96da-70b77420b169 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Sep 06 12:03:05.322051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 895/1839] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:05.490704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:05.493422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:05.499797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.500291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.500729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.501426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.501935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.502372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.532945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c7100d6-61f2-40ff-84ed-a86da3c093e6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Sep 06 12:03:05.533524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 945/1840] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:05.607840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:05.609763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:05.616149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.616636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.617089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.618483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:05.618945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:05.619374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:05.651638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5bb809b9-b31e-46d6-828a-5d65e90be88c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048576 Sep 06 12:03:05.652220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 896/1841] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:06.271177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:06.273374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:06.281022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.281515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.281993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.282700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.283159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.283589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.315540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92b1f6a8-9945-4cfa-b628-067a79cd48b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Sep 06 12:03:06.316120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 946/1842] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:06.338548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:06.342287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:06.351324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.352408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.352985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.353756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.354219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.354652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.386567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c19c69db-f807-4c84-a685-dad631aeab62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055713 Sep 06 12:03:06.387144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 897/1843] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:06.548140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:06.550621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:06.561496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.562184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.562625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.563530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.563986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.564410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.597869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-660ee4e8-6adc-48a2-99c2-537cb0b5e3cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054800 Sep 06 12:03:06.598435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 947/1844] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:06.665385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:06.667604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:06.674010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.674532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.675003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.675702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:06.676159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:06.676587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:06.705816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5a8e3535-ffcb-4b67-9f6b-3d6c75939178 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045070 Sep 06 12:03:06.706362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 898/1845] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:07.328225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:07.330286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:07.337039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.337521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.337984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.338672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.339122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.339540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.369354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2f7d01aa-1eb1-4c4e-a0b8-9e56c47b94db tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Sep 06 12:03:07.369950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 948/1846] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:07.400481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:07.402707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:07.409870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.410496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.410947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.411650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.412101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.412532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.420669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:07.448040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f04abb3-b14a-421d-801e-0dee7e70cfef tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052929 Sep 06 12:03:07.448609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 899/1847] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:07.614238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:07.616303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:07.622699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.623182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.623616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.624300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.624747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.625163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.656234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e889e604-9839-451e-a7ec-a67c539fe3b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Sep 06 12:03:07.656794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 949/1848] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:07.719065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:07.721229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:07.728547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.729032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.729473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.730314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:07.730774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:07.731201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:07.761484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bcdb0dc1-598e-4a13-ae37-c34b320edf05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046603 Sep 06 12:03:07.762087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 900/1849] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:08.382289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:08.385055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:08.391520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.392012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.392453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.393147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.393605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.394062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.423750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cde493f3-6cfb-4522-a02b-14ee12a17d07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Sep 06 12:03:08.424331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 950/1850] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:08.463009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:08.465441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:08.471911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.472394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.472822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.473516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.473993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.474416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.504899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ff19ecd-e7f7-4da2-854a-2202d93ac5d2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Sep 06 12:03:08.505456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 901/1851] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:08.670513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:08.672695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:08.678676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.679159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.679596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.681443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.681930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.682398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.711108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58248c80-cb32-41c3-8e74-642326647b39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Sep 06 12:03:08.712311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 951/1852] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:08.774169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:08.776296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:08.782648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.783128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.783579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.784238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:08.784685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:08.785102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:08.815494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37d1a2fc-f46b-4b7d-945b-c9c4a5cc50ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045689 Sep 06 12:03:08.816053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 902/1853] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:09.436865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:09.439016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:09.445474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.446034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.446467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.447227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.447676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.448094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.478929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1cfad852-16fe-464d-bfab-b9dd3ec8253e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045884 Sep 06 12:03:09.479515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 952/1854] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:09.517074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:09.519291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:09.525878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.526356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.526786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.527472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.527920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.528337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.558454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0c159321-69e7-4bd1-b46a-689afdbabdd7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Sep 06 12:03:09.559010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 903/1855] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:09.724498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:09.728029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:09.733948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.734441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.734869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.735558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.736033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.736453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.764805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-06508d73-a181-4a8f-8d19-415276f88274 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Sep 06 12:03:09.765361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 953/1856] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:09.828194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:09.830400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:09.836886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.837561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.838113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.838819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:09.839270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:09.839700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:09.870106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c312c0bb-271f-4a82-bebf-6a345b6c1b00 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045868 Sep 06 12:03:09.870666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 904/1857] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:10.492034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:10.495080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:10.501757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.502247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.502689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.503395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.503852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.504278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.534857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae176edf-863e-4771-bfde-8ec1c1a8fbd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Sep 06 12:03:10.535418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 954/1858] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:10.570566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:10.573314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:10.579759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.580247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.580689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.581383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.581867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.582300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.611303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a5f14ff1-9bb2-441d-9123-e3388fddbdb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Sep 06 12:03:10.611856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 905/1859] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:10.777582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:10.779721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:10.786067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.786555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.786987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.787676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.788124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.788543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.814948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:10.820291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e34b7b9-68a4-4c37-be45-8b9a74b3fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046950 Sep 06 12:03:10.820870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 955/1860] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:10.884393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:10.886623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:10.892575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.893062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.893502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.894225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:10.894681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:10.895364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:10.924628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22765d7e-7c62-4fc0-9867-41ea922c4832 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Sep 06 12:03:10.925190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 906/1861] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:03:11.547791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:11.549946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:11.557198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.557709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.558152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.558847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.559339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.559800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.589812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a9904b7-a63d-4f17-a5f7-22e71f04f5ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Sep 06 12:03:11.590380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 956/1862] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:11.623993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:11.626254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:11.632813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.633325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.634097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.634488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.634943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.635368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.665881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5f54d18e-77a3-4a46-9bbf-fbb55ecd22f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 Sep 06 12:03:11.666441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 907/1863] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:11.833040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:11.835121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:11.841235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.841926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.842360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.843043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.843489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.843935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.874551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3aca9ca5-8a9f-4c23-a29f-ea7e18e96603 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Sep 06 12:03:11.875137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 957/1864] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:11.937666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:11.939885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:11.945917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.946409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.946882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.947582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:11.948041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:11.948471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:11.982229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa7f3934-bd8c-4eb8-87de-328dbd4e45dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048553 Sep 06 12:03:11.982802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 908/1865] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:12.602976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:12.605150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:12.612185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:12.612683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:12.613157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:12.613856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:12.614317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:12.614742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:12.651364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-55d2e451-0d11-465a-9bc3-02876a83ddcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052796 Sep 06 12:03:12.651967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 958/1866] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:12.678500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:12.680769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:12.687619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:12.688107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:12.688552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:12.689249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:12.689735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:12.690161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:12.726575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d96759b2-ce8e-4785-873d-92e180d06f96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051947 Sep 06 12:03:12.727873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 909/1867] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:12.888024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:12.890205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:12.896993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:12.897491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:12.898013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:12.899291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:12.900128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:12.900443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:12.936744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b3a58206-596f-4863-9f10-5af0e100010c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052720 Sep 06 12:03:12.937542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 959/1868] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:12.995275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:12.997404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:13.003497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.003983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.004429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.005125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.005576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.006028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.038416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d379602a-3e48-4579-83d9-5aa2e1220d66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047233 Sep 06 12:03:13.039009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 910/1869] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:13.666568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:13.668855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:13.675636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.676119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.676546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.677245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.677714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.678133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.709161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6428800c-db00-4acf-8de3-397a2e8da777 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047421 Sep 06 12:03:13.709753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 960/1870] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:13.740033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:13.742233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:13.748952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.749432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.749943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.750645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.751095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.751517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.784356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-05721165-bd02-4463-82e2-cf343c68cf39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048388 Sep 06 12:03:13.784931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 911/1871] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:13.949311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:13.951487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:13.957638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.958168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.958607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.959311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:13.959767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:13.960199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:13.991958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-344bbea3-f300-4ee7-bc86-9baa666a1341 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Sep 06 12:03:13.992640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 961/1872] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:14.051941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:14.054181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:14.060760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:14.061243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:14.061702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:14.062860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:14.062860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:14.063272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:14.098881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0ca7b12-93a3-4772-833d-489bcafd3d9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050913 Sep 06 12:03:14.099471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 912/1873] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:14.722968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:14.725243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:14.732678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:14.733168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:14.733664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:14.734377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:14.734829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:14.735254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:14.767683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9d6883d-327a-476c-bb8d-5a3a9326085e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Sep 06 12:03:14.768168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 962/1874] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:14.796685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:14.798933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:14.806443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:14.806935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:14.807373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:14.808080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:14.808538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:14.808960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:14.839984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-85234deb-691b-4c54-b576-c668fbf80574 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Sep 06 12:03:14.840563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 913/1875] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:15.004788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:15.006989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:15.014249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.014743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.015222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.015983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.016439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.016865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.049730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a00fca9-823d-447c-ac2c-7a7399f405ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048848 Sep 06 12:03:15.050327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 963/1876] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:15.111820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:15.114050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:15.120875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.121364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.121846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.122548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.123000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.123426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.155741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0001147b-18d4-44c3-a015-cfa6b4356bd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047926 Sep 06 12:03:15.156324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 914/1877] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:15.780791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:15.782959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:15.789797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.790279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.790719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.791412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.791875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.792299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.826965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b805748c-16b5-48c1-b067-3f55158d7519 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050101 Sep 06 12:03:15.827557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 964/1878] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:15.852936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:15.855282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:15.862147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.862634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.863072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.863774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:15.864221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:15.864640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:15.895558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:15.901245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41f39407-95a6-4ad3-afd5-c8bd9e30147f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052521 Sep 06 12:03:15.901864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 915/1879] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:16.063413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:16.065539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:16.072465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.072960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.073400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.074163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.074618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.075041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.110039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d505c793-a311-402a-90a8-e74302a3c512 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050614 Sep 06 12:03:16.110640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 965/1880] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:16.169104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:16.171486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:16.177869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.178358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.178797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.179508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.180017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.181793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.212968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-03d30035-907c-48b5-b0a9-3ee9b7c53d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048359 Sep 06 12:03:16.213544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 916/1881] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:16.840556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:16.844333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:16.851136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.851724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.852115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.853454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.853941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.854371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.891643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5fd30a75-1b52-4e6e-8d03-2e70a09be45e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055518 Sep 06 12:03:16.892241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 966/1882] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:16.914169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:16.916396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:16.923135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.923623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.924086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.924777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:16.925236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:16.925680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:16.956484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3792e8b4-757f-40df-a3b5-62f26495346a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046416 Sep 06 12:03:16.957085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 917/1883] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:17.122997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:17.125245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:17.127273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:17.133538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.134230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.134670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.135704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.135843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.136286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.169176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c57c3fa-eb78-43a1-b9ec-5fc06184c268 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Sep 06 12:03:17.170060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 967/1884] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:17.225747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:17.228472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:17.235004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.235497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.235932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.236629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.237149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.237575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.271234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-433caa4e-98aa-4e00-9100-421805c6f940 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049398 Sep 06 12:03:17.271809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 918/1885] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:17.905725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:17.907864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:17.914086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.914827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.915272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.915978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.916488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.916867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.949357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dd264b39-0378-4579-bb3f-79e7e1930f3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048151 Sep 06 12:03:17.949989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 968/1886] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:17.968821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:17.971025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:17.977417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.977930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.978403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:17.979076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:17.979531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:17.979945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:18.011288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0189b19c-b6c7-4b00-b254-81f0b4ad48aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Sep 06 12:03:18.011875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 919/1887] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:18.183262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:18.185335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:18.191538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:18.192028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:18.192464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:18.193347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:18.194291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:18.194291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:18.225181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3a1b6c4-c075-46e7-8604-bdb087904b44 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Sep 06 12:03:18.225785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 969/1888] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:18.284707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:18.286875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:18.293428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:18.293950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:18.294388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:18.295085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:18.295533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:18.295951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:18.328435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ab86005-b091-44ee-ab01-7b989abb8613 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047343 Sep 06 12:03:18.329483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 920/1889] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:18.962822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:18.964971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:18.971471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:18.971951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:18.972390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:18.973090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:18.973540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:18.973993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.008874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-64d3d03c-b6a4-4d30-95f4-d440e4d6de39 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050227 Sep 06 12:03:19.010426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 970/1890] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:19.024674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:19.026942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:19.033785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:19.034276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:19.034719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.035429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:19.035887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:19.036313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.067123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2875c82-9a59-4556-8441-42a2eda6127a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047357 Sep 06 12:03:19.067703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 921/1891] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:19.240599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:19.243524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:19.250648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:19.251151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:19.251633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.252469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:19.252761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:19.253225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.286706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe466f59-0931-466b-9f1f-c4e7ea960591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050865 Sep 06 12:03:19.287212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 971/1892] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:19.342605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:19.344751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:19.350874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:19.351371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:19.351815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.352769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:19.353065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:19.353484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:19.383850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ea070ebd-4e92-42bd-9273-3877783fd5e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044674 Sep 06 12:03:19.384424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 922/1893] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:20.022720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:20.025167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:20.032020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.032511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.032961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.033691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.034153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.034580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.055873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:20.071736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c16f21c8-4335-441d-acec-655f0850171f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052634 Sep 06 12:03:20.072353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 972/1894] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:20.081894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:20.084239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:20.091253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.092483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.092483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.092935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.093422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.094441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.127593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7be45df6-b655-4418-9ed7-908e5ac2b5d9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049704 Sep 06 12:03:20.128172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 923/1895] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:20.301293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:20.303479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:20.310667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.311080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.311511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.312207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.312653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.313072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.345615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dfe351d5-775b-4bbd-84be-d763f2d46dc0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049269 Sep 06 12:03:20.346238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 973/1896] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:20.396834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:20.399740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:20.405876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.406357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.406793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.407480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:20.407930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:20.408354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:20.438660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1670dcbd-afc9-4953-941e-1e1d7c34cea5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046062 Sep 06 12:03:20.439207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 924/1897] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:21.084381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:21.086768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:21.093270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.093804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.094249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.094947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.095405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.095831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.126162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-def02fc0-1b16-4a61-a349-2d784ec71460 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Sep 06 12:03:21.126646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 974/1898] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:21.141373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:21.143581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:21.150712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.151193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.151632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.152329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.152784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.153211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.182650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6750315b-97c4-4b7b-bffc-5592f484648d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045259 Sep 06 12:03:21.183209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 925/1899] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:21.359619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:21.361837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:21.368987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.369470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.369935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.370627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.371086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.371505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.401143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2e773803-58e6-4e26-9fe5-b7878daba7cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 Sep 06 12:03:21.401631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 975/1900] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:21.451583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:21.453779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:21.459723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.460209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.460647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.461798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:21.462015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:21.462452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:21.491716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e7e321a1-0dd4-4bbd-8e04-1bcc5c42fc8c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044171 Sep 06 12:03:21.492275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 926/1901] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:22.139727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:22.142071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:22.149821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.150322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.150891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.151609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.152073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.152590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.186219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89d2a522-52b0-4797-92a1-086396742aa8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050433 Sep 06 12:03:22.186718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 976/1902] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:22.194900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:22.197880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:22.200241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:22.207513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.207994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.208428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.210055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.210530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.210955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.251582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c490fbed-1aed-42d3-9ab4-5de1a35d650d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060465 Sep 06 12:03:22.252572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 927/1903] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:22.415812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:22.420268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:22.426992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.427480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.427910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.428687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.429472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.430417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.469072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f786aae-e10c-4d1d-87d5-5a090269880a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058393 Sep 06 12:03:22.469576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 977/1904] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:22.504722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:22.506972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:22.514007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.514505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.514947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.515654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:22.516112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:22.516539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:22.551142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62a47d82-9446-471a-ace5-085cd92aba9c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050429 Sep 06 12:03:22.551742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 928/1905] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:23.199264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:23.201433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:23.208144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.208632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.209075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.209827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.210289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.210718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.243087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-19bc6d55-b5cc-4ebc-bc97-b406662df3c7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047980 Sep 06 12:03:23.243672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 978/1906] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:23.265138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:23.269173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:23.276592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.277075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.277522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.278260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.278719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.279175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.309581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f8bd24a-2381-4254-ac5a-0ada12ba7b44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048363 Sep 06 12:03:23.310180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 929/1907] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:23.482672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:23.484837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:23.490868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.491340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.491775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.492963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.494033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.494506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.525607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3a64efa-a978-4824-a4d0-0c18225eab50 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Sep 06 12:03:23.526130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 979/1908] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:23.564313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:23.566516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:23.572711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.573228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.574134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.574855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:23.575301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:23.575729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:23.608352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ca4f3f12-9d4d-4336-9e65-bebf6edf812e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048088 Sep 06 12:03:23.608922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 930/1909] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:24.255647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:24.258595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:24.265500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.266010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.266450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.267138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.267578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.268001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.298706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0369aea0-1377-425f-a99f-25704049c847 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 Sep 06 12:03:24.299267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 980/1910] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:24.322191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:24.324262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:24.331033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.331524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.331965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.332705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.333160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.333588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.366665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e5027e7a-7a7a-41e4-9e08-3ae17762e79e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Sep 06 12:03:24.367256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 931/1911] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:24.539814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:24.541997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:24.548000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.548493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.548930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.549634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.550131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.550558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.580567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ec37fb2e-a657-4ad4-a971-57d5e8de56c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Sep 06 12:03:24.581050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 981/1912] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:24.621785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:24.623977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:24.630340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.630829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.631273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.632022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:24.632436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:24.632864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:24.652839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:24.666473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aa6e99fa-e622-48fb-80bc-759c6891b40f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049340 Sep 06 12:03:24.667054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 932/1913] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:25.311914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:25.314091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:25.321164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.321665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.322235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.322947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.323403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.323834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.355572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c1e4b26-dda7-4cd2-975c-ccf5c5318d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047591 Sep 06 12:03:25.356170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 982/1914] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:25.380221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:25.382345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:25.389363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.389896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.390335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.391038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.391495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.391924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.423551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3ea4e7e8-8c80-486a-a457-6c5144cf94b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 Sep 06 12:03:25.424128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 933/1915] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:25.593466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:25.595621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:25.601537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.602049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.602483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.603236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.603709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.604130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.635505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b0b6f1ca-1604-4fd3-8188-18cdaa7d2991 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Sep 06 12:03:25.636103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 983/1916] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:25.679571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:25.682417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:25.688801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.689331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.689811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.690521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:25.690982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:25.691564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:25.723960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-854beb5c-5c3e-4d62-a62e-57ca65278f5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048442 Sep 06 12:03:25.724555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 934/1917] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:26.369600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:26.372312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:26.379456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.379944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.380383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.381339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.381986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.382517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.419235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-795c271b-e966-40a8-8713-aa9bf8210477 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054283 Sep 06 12:03:26.419823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 984/1918] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:26.436466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:26.438867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:26.446187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.446676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.447118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.447850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.448308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.448733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.479489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba890c10-acbd-45c0-a6ae-40151042117b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Sep 06 12:03:26.480082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 935/1919] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:26.649453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:26.651659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:26.658034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.658579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.659061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.659790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.660285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.660711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.690644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-936796f7-def0-48a5-9708-82e4769635bc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Sep 06 12:03:26.691313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 985/1920] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:26.736681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:26.738880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:26.745228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.745727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.746161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.746842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:26.747287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:26.747704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:26.778381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ed671314-4cf9-4411-8150-9b94a363ff4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045656 Sep 06 12:03:26.778937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 936/1921] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:27.432487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:27.434796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:27.441097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.441592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.442071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.442942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.443507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.444075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.476122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f5b7c9ef-92dc-4988-9ed2-262cbaee0b1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048176 Sep 06 12:03:27.477748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 986/1922] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:27.492275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:27.495527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:27.502156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.502642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.503084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.503794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.504252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.504711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.535613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4e34cbd-5b80-4b76-a4ed-5a43f3202329 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Sep 06 12:03:27.536184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 937/1923] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:27.704000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:27.706190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:27.713386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.713911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.714356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.715066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.715518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.715944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.746902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef470539-7a4a-4361-be09-be8ba2eaa5fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046843 Sep 06 12:03:27.747401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 987/1924] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:27.791303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:27.793529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:27.799680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.800165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.800604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.801307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:27.801788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:27.802218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:27.832436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-feff5541-f388-4b22-9605-f20d4519b062 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046008 Sep 06 12:03:27.833013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 938/1925] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:28.490118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:28.492369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:28.499020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.499512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.499950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.500663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.501122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.501583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.534295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-de3d6ab4-aafb-406c-a120-f5df5e8ce113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048045 Sep 06 12:03:28.534780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 988/1926] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:28.548892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:28.551119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:28.558475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.558967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.559411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.560109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.560562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.560985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.592965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9d876a17-58dd-4c3a-91fc-279e221b58c8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 Sep 06 12:03:28.593540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 939/1927] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:28.759981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:28.762172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:28.768940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.769428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.769899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.770857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.771309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.771736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.776858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:28.805368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c56599f1-dfbc-4866-b522-0ea8f75fda6f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Sep 06 12:03:28.806286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 989/1928] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:28.845960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:28.848198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:28.854706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.855197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.855642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.856348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:28.856866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:28.857235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:28.891875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20535e8b-e463-41b2-9491-f7c31e6c7150 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050055 Sep 06 12:03:28.892466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 940/1929] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:29.546961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:29.549011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:29.555686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.556179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.556618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.557318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.557808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.558240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.590490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a40659ca-41b3-4a8b-a75e-c944ff5cf704 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047545 Sep 06 12:03:29.591060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 990/1930] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:29.604615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:29.606819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:29.613200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.613720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.614155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.614837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.615285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.615709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.647146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a051cba8-ad1e-4453-bb62-42039cc45549 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046507 Sep 06 12:03:29.647745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 941/1931] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:29.818646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:29.821279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:29.827901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.828421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.828870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.829572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.830056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.830484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.860804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cf5588a0-c9e2-4a07-8a83-07aadf06e3e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Sep 06 12:03:29.861387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 991/1932] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:29.905437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:29.907651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:29.913930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.914477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.914905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.915607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:29.916049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:29.916463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:29.947545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-933284bc-50fd-4b9b-ac6f-b96cacbf78e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046027 Sep 06 12:03:29.948114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 942/1933] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:30.604078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:30.606231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:30.612641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.613134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.613604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.614361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.614818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.615254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.649878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3d6040f5-c900-44d9-be57-962bfff177d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050335 Sep 06 12:03:30.650480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 992/1934] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:30.660731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:30.663050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:30.670750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.671248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.671697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.672410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.672886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.673313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.704059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dcab0544-506d-4ca1-a0fa-ee56d6538ddf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Sep 06 12:03:30.704640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 943/1935] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:30.874353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:30.876424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:30.883858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.884405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.884847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.885559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.886044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.886471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.918216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e121e801-49f2-4265-b7b2-3e23028ab8b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047862 Sep 06 12:03:30.918801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 993/1936] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:30.960289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:30.962771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:30.969434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.969962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.970399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:30.971146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:30.971602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:30.972031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.002931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0baf1a85-b677-4564-a6f3-afc416d4daa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046674 Sep 06 12:03:31.003510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 944/1937] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:31.663109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:31.665407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:31.671522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:31.672010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:31.672456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.673156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:31.673617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:31.674064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.705381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a6ac89d1-f812-4355-85b1-9e19bd6b6349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Sep 06 12:03:31.705997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 994/1938] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:31.716838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:31.719102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:31.725694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:31.726181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:31.726613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.727303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:31.727844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:31.728265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.760646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a734c875-0118-4f17-a9b7-4a2aa04aa9ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047599 Sep 06 12:03:31.761134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 945/1939] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:31.931596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:31.933855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:31.940663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:31.941163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:31.941608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.942428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:31.942889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:31.943318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:31.975702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0d09d1c-b2ef-4bc0-bc25-ffe90f8fd5dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048686 Sep 06 12:03:31.976302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 995/1940] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:32.016060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:32.018170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:32.024550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.025045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.025479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.026217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.026669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.027092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.058673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-334b6122-b8e1-4070-917f-0e859654c66b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046807 Sep 06 12:03:32.059254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 946/1941] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:32.723127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:32.727120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:32.735402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.735901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.736347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.737065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.737524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.738078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.771968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-488d792a-2972-4417-9cef-63e00cea951d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056721 Sep 06 12:03:32.772551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 996/1942] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:32.773150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:32.776106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:32.783244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.783850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.784292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.785011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.785467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:32.785924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:32.817289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b136de29-c427-4abf-a427-d83fdab06e3d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048493 Sep 06 12:03:32.818055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 947/1943] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:32.989285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:32.991460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:32.999310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:32.999810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.000229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.000928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.001374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.001829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.033155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b8ed074a-a7a3-4094-ab5d-9cee67aea148 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047964 Sep 06 12:03:33.033747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 997/1944] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:33.071957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:33.074044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:33.080046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.080528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.080956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.081698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.082145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.082569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.112842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ff7394ae-ec80-481c-8d85-4c2e6f5c42df tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045481 Sep 06 12:03:33.113452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 948/1945] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:33.785898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:33.788091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:33.795067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.795543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.795978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.796691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.797126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.797534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.828914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-170b422a-85a8-4e74-bd4f-9ab3108dab9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Sep 06 12:03:33.829381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 998/1946] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:33.830666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:33.832754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:33.844415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.844906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.845349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.846089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:33.846551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:33.846980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:33.851144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:33.879189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a0a8e665-000e-4d76-ba7c-416fc65094af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052728 Sep 06 12:03:33.879678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 949/1947] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:34.045837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:34.047976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:34.054525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.055655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.056225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.056934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.057391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.057856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.090135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-760ae2a0-98e5-4398-b64a-af429695ed07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048231 Sep 06 12:03:34.090710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 999/1948] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:34.126575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:34.128756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:34.135857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.136265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.136697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.137398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.137874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.138294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.171079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-689f5398-7225-4668-a4e4-896f17400c0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048732 Sep 06 12:03:34.171648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 950/1949] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:34.841286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:34.843525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:34.849758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.850242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.850671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.851364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.852358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.852781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.884620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99f12be1-cfb7-4298-b3f1-3d25bab38d7e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047440 Sep 06 12:03:34.885262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1000/1950] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:34.892415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:34.894691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:34.902359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.902854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.903306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.904044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:34.904509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:34.904938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:34.938534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7c0ad546-946f-4b9f-b356-aa67bf3f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050152 Sep 06 12:03:34.939037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 951/1951] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:35.103576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:35.105818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:35.112686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.113168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.113608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.114349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.114806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.115231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.147970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-894381e2-779d-41c1-9f0d-0debba0192f3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Sep 06 12:03:35.149123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1001/1952] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:35.184258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:35.186588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:35.192703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.193106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.193605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.194390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.194748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.195189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.227731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-748d3d1f-97e8-435a-831e-91ff048a5e29 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046941 Sep 06 12:03:35.228442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 952/1953] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:35.900418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:35.902626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:35.908886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.909383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.909833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.910593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.911051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.911475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.945452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6f658da5-a992-4153-acad-9f664a61da74 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049622 Sep 06 12:03:35.946706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1002/1954] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:35.951973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:35.954164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:35.960582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.961259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.961848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.962562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:35.963023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:35.963458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:35.993827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8796ca51-6723-4966-af20-f9e788c4d08e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Sep 06 12:03:35.994397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 953/1955] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:36.161808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:36.163991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:36.170604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.171101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.171542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.172246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.172705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.173133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.204753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-502bf569-921c-4a6c-939c-4cb71c59cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046917 Sep 06 12:03:36.205286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1003/1956] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:36.241169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:36.244172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:36.250444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.250933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.251376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.252206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.252527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.252955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.285930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-86eb5eb5-53b6-4196-99b7-80ef60845565 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048595 Sep 06 12:03:36.286440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 954/1957] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:36.959034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:36.965728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:36.967793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.968275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.968701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:36.969400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:36.969877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:36.970295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.001521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b2e70577-86c6-4ab2-9f85-55748bd5a1a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Sep 06 12:03:37.002125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1004/1958] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:37.006737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:37.009724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:37.016472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:37.016966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:37.017407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.018139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:37.018674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:37.019200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.051072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6c656d89-19b0-427a-af63-3478fad339c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048279 Sep 06 12:03:37.051657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 955/1959] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:37.218656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:37.220787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:37.227880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:37.228367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:37.228836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.229536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:37.230022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:37.230444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.256325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:37.263171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3fec751-43b9-4298-aab3-b497930e5b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048497 Sep 06 12:03:37.263763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1005/1960] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:37.299069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:37.301252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:37.307523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:37.308013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:37.308455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.309291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:37.309869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:37.310124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:37.344289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a51d4e3-1934-4e74-a27f-41168bff4a93 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049248 Sep 06 12:03:37.344858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 956/1961] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:38.015590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:38.018415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:38.026379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.026934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.027411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.028188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.028681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.029144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.060068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6ae044fd-f48e-4b7c-bdc0-f3b2a64f4e7f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048928 Sep 06 12:03:38.060639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1006/1962] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:38.063579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:38.065815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:38.073021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.073499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.073967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.074661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.075109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.075529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.105552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-417a4245-474b-4a25-bb86-8c8b146868ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045826 Sep 06 12:03:38.106163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 957/1963] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:38.276305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:38.278518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:38.284983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.285481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.285965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.286669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.287128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.287553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.323860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fd814c26-a29c-4487-8541-08891527bde6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051649 Sep 06 12:03:38.324527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1007/1964] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:38.357847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:38.360074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:38.366105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.366599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.367835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.368213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:38.368776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:38.369206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:38.400976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d207f5f0-50dc-40ae-81f1-57ebcbe7fd6c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047436 Sep 06 12:03:38.401569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 958/1965] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:03:39.073063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:39.075283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:39.081518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.082043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.082484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.083194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.083652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.084081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.117375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c49c27eb-7020-478a-94b7-5022dcec8f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Sep 06 12:03:39.118009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1008/1966] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:39.118157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:39.120501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:39.126920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.127413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.127859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.128574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.129030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.129461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.161869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1bff897c-eb0d-4c6e-ad3e-d195e6c7052a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048000 Sep 06 12:03:39.162448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 959/1967] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:39.337365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:39.339589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:39.346263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.346752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.347190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.347895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.348348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.348771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.382998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e8ad258-6858-48a3-9319-61459985555f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050226 Sep 06 12:03:39.384211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1009/1968] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:39.415484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:39.417735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:39.424944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.425435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.425896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.426601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:39.427051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:39.427472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:39.458980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-592cf7e6-cfb6-45a7-a668-00c31235553a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048780 Sep 06 12:03:39.459567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 960/1969] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:40.131158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:40.133890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:40.140339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.140835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.141281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.142030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.142492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.142919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.177456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-98c9f541-f24d-4099-a400-d3308915dfa5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050281 Sep 06 12:03:40.178077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1010/1970] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:40.178348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:40.181438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:40.188382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.188871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.189308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.190062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.190542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.190954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.224855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f7956571-2554-4480-a75f-1796f3584335 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053046 Sep 06 12:03:40.225453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 961/1971] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:40.396595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:40.399931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:40.406575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.407060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.407497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.408194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.408654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.409071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.440987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a54800da-bf7b-4aff-87a0-0f158b6eb9b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Sep 06 12:03:40.441564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1011/1972] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:40.472121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:40.474342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:40.480548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.481039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.481473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.483008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:40.483471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:40.483899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:40.516774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8923c295-a59d-407d-a277-97d98f9d1660 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048721 Sep 06 12:03:40.517357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 962/1973] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:41.191556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:41.193746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:41.200173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.200662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.201101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.201856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.202315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.202741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.234087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4ba2aec5-d7e5-4b5d-a656-9a6af51ae431 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047379 Sep 06 12:03:41.234658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1012/1974] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:41.237106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:41.239365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:41.245979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.246458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.246890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.247597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.248044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.248461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.280964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e6adab3c-223f-4248-a501-e7b988a6aa68 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047832 Sep 06 12:03:41.281535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 963/1975] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:41.455700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:41.457949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:41.465633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.466166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.466609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.467331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.467792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.468227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.511313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e355802-f3a6-460a-a3d6-494c2641b7a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059718 Sep 06 12:03:41.511942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1013/1976] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:41.530664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:41.532836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:41.539111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.539606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.540144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.540841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:41.541296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:41.541745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:41.573076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34c3d5a4-371d-4ca8-b7f2-bf8fea9bf78c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046537 Sep 06 12:03:41.573678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 964/1977] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:42.247941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:42.250265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:42.256717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.257223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.258274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.259024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.259486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.259919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.293381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2ccea7fb-6000-4e30-ba74-e3b324766b7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049534 Sep 06 12:03:42.293729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:42.294003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1014/1978] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:42.295739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:42.302855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.303112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.303478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.304198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.304731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.306118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.333843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:42.339838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc0009a5-8b4f-491c-9fc1-32cdd22a4d13 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050873 Sep 06 12:03:42.340436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 965/1979] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:42.524186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:42.526404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:42.532906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.533384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.533933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.534650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.535112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.535535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.566323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9cc376d2-924c-4cc1-bdd9-40c1b6ccc7c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Sep 06 12:03:42.566886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1015/1980] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:42.585892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:42.588229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:42.594444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.594932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.595372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.596078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:42.596533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:42.596961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:42.628310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0365562f-00a8-44ec-af4f-27aefbeb4e7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046422 Sep 06 12:03:42.628888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 966/1981] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:43.307689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:43.309855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:43.315936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.316426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.316862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.317566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.318050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.318471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.352620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:43.353682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a86b2523-82c1-454a-8a53-13b5e2a0ce4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050766 Sep 06 12:03:43.354445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1016/1982] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:43.355123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:43.361907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.362397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.362833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.363534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.363992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.364414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.397263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-642b62d3-f49b-40bf-9f1e-78891958c200 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Sep 06 12:03:43.397892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 967/1983] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:43.579907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:43.582032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:43.584364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:43.590163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.590650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.591083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.591785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.592234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.592654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.623965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e73f54b9-3979-4ef4-939f-4225edfa5e6c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048739 Sep 06 12:03:43.624536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1017/1984] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:43.643511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:43.646150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:43.652361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.652839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.653280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.654015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:43.654467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:43.654880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:43.686550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3bc2280f-c629-48d0-be59-4b015d73729d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048579 Sep 06 12:03:43.687116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 968/1985] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:03:44.366654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:44.368773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:44.374917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.375393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.375826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.376518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.376964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.377380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.409298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e2add15-5420-4a81-b7a9-c4e6bb87dd27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Sep 06 12:03:44.410297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1018/1986] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:44.414120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:44.418598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:44.427304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.427807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.428250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.428979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.429440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.429907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.461796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9ec6aff-5759-4d29-8c09-d047320cd28f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054068 Sep 06 12:03:44.462578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 969/1987] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:44.637364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:44.639593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:44.646499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.646985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.647421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.648125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.648578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.649748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.680872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1afa682f-6fb5-441d-b049-ffddaee03532 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047663 Sep 06 12:03:44.681390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1019/1988] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:44.699971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:44.702170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:44.708181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.708668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.709107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.709868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:44.710357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:44.710820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:44.743343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a57cc01-8425-4369-9d76-973e370e5e04 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047955 Sep 06 12:03:44.743926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 970/1989] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:45.422499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:45.424849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:45.431534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.432030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.432472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.433182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.433659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.434104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.470215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b1d72ebf-4aad-44ec-bab6-363c2862a96a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051772 Sep 06 12:03:45.470802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1020/1990] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:45.475191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:45.478301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:45.485321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.485922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.486418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.487190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.487712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.488193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.528860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f541f69-2722-4a17-901c-47f7140c9b5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057953 Sep 06 12:03:45.529454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 971/1991] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:45.693472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:45.696252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:45.702889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.703369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.703800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.704487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.704934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.705352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.737779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cec1bfbe-6047-4f5e-b43c-47e7103f9949 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048175 Sep 06 12:03:45.738366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1021/1992] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:45.756257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:45.759009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:45.765132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.765621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.766095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.766802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:45.767263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:45.767690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:45.799342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b8d55356-8280-4d7e-93f1-1ab69b86766e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047184 Sep 06 12:03:45.799914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 972/1993] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:46.482493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:46.484648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:46.491030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.491511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.491944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.492643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.493087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.493507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.512207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:46.527767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-444b5a69-d9f1-498a-bba6-d5b60d8f4fca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049203 Sep 06 12:03:46.528355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1022/1994] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:46.541688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:46.543889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:46.550916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.551257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.551706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.552442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.552900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.553336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.587518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-76872d12-1af8-4f15-a932-7b92377de4c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049723 Sep 06 12:03:46.588109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 973/1995] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:46.750070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:46.752221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:46.761538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.762293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.762882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.763754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.764443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.765136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.798407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-506176cd-a4ed-424c-98ff-1a2f2dcc8e41 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052384 Sep 06 12:03:46.798979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1023/1996] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:46.812065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:46.814226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:46.820068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.821123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.821597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.822389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:46.822832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:46.823475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:46.853170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-804de304-b32c-4811-81d3-04d8188eaa4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044957 Sep 06 12:03:46.853756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 974/1997] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:47.540913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:47.543306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:47.549349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.549868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.550299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.550990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.551436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.551857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.581387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5edae770-eb51-4498-8e20-f02b2c75fb4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Sep 06 12:03:47.581979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1024/1998] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:47.600370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:47.603178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:47.609553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.610067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.610500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.611178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.611627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.612043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.643122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-30234dc6-118a-4536-b038-9187b08e6a37 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Sep 06 12:03:47.643708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 975/1999] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:47.811376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:47.813461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:47.820351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.820952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.821289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.822107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.822557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.822973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.853812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7906b0d0-89f1-4b91-bcb4-b5d3b8d58615 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Sep 06 12:03:47.854382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1025/2000] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:47.865827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:47.868055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:47.874101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.874586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.875162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.876137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:47.876646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:47.877336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:47.908937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-137d6b61-2a57-483a-a784-33af0b68a929 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047081 Sep 06 12:03:47.909513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 976/2001] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:48.595187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:48.597341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:48.604042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.607589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.607589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.607589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.607589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.608081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.638490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ee310ed-4b59-4f00-80bd-a1a8d91bd793 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047771 Sep 06 12:03:48.639987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1026/2002] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:48.655962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:48.658157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:48.660871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:48.667205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.667697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.668142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.668849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.669307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.669793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.700353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bd816370-4656-41f2-bfb7-5eee65b6c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048296 Sep 06 12:03:48.700924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 977/2003] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:48.866488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:48.869411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:48.876523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.876973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.877415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.878316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.878610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.879048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.909027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71825758-79cc-48ef-94be-255439e3bdce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Sep 06 12:03:48.909616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1027/2004] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:48.921814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:48.923998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:48.930646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.931246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.931680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.932368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:48.932814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:48.933234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:48.962515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-169cd95b-663a-4e5a-ac0c-7827d5cf6d88 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044686 Sep 06 12:03:48.963078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 978/2005] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:49.651942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:49.654115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:49.660177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.660670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.661112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.661848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.662311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.662740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.694333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8437e2f-1f09-46b4-a535-8a84cbb130f8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047121 Sep 06 12:03:49.694904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1028/2006] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:49.712800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:49.715014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:49.722561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.723057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.723502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.724211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.724671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.725099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.755852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e12e4a03-795d-4825-9b95-abbc994b4056 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047622 Sep 06 12:03:49.756452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 979/2007] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:49.922285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:49.924472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:49.931782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.932268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.932711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.933415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.933901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.934334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.965000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36f18fbb-f344-4722-bc0b-94b9abdbb466 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046696 Sep 06 12:03:49.965562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1029/2008] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:49.975755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:49.978047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:49.984057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.984541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.984979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:49.985708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:49.986200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:49.986628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.017186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1e684945-7ade-4dd2-a383-84f77bffbe77 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045404 Sep 06 12:03:50.017790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 980/2009] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:50.708042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:50.710127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:50.716150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.716629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.717069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.717788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.718246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.718668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.749209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2ce9275d-d342-4fb9-b1dc-81bf26a89286 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Sep 06 12:03:50.749826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1030/2010] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:50.768373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:50.770554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:50.777396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.777920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.778363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.779063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.779517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.779944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.810324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b1c8511c-9419-4f72-b791-c404059e2a20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 06 12:03:50.810899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 981/2011] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:50.979502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:50.981635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:50.988191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.988667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.989102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:50.989827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:50.990275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:50.990694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.021356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6607e487-f7a0-4e96-87f3-32de5a34b029 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Sep 06 12:03:51.021947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1031/2012] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:51.030239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:51.032372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:51.038383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.038866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.039886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.040821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.041278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.041725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.060765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:51.074072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-107c563d-1ced-4131-be4b-a0864abbdbc2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047848 Sep 06 12:03:51.074662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 982/2013] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:51.762797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:51.764930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:51.766974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:03:51.767124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:03:51.768124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:03:51.768235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:03:51.775654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.776138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.776574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.777267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.777754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.778180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.811909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49572ab3-f356-4b06-9d5b-857ba0acaa3f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053987 Sep 06 12:03:51.812476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1032/2014] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:51.822568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:51.824809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:51.831277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.831769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.832213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.832912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:51.833372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:51.833834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:51.863756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-633ba2e3-3609-4d94-91cb-593e3c72b9ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Sep 06 12:03:51.864320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 983/2015] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:52.033042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:52.035147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:52.041770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.042261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.042701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.043397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.043856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.044284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.074589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f97ef7f-7631-43d0-8221-54c145fbd113 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Sep 06 12:03:52.075165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1033/2016] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:52.086912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:52.089112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:52.095129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.095602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.096037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.096726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.097176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.097598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.129410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-97ff3b5f-2cc8-4521-9744-b5b91f524e0a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046511 Sep 06 12:03:52.130125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 984/2017] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:52.825427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:52.827798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:52.834060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.834551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.834977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.835673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.836160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.836793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.867768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-06243f2c-84d4-4e5f-9bde-cd92decf067f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046481 Sep 06 12:03:52.868350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1034/2018] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:52.876969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:52.879158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:52.886604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.887100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.887546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.888253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:52.888713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:52.889144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:52.920028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f94c55ae-9c7d-4ccf-99c4-0e8a71738ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047093 Sep 06 12:03:52.920598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 985/2019] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:53.088391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:53.090773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:53.097856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.098355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.098804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.099519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.100004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.100428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.136672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef0e1196-b3a3-45f9-92b6-dc3305661db5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052964 Sep 06 12:03:53.137268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1035/2020] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:53.143886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:53.145891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:53.152073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.152556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.152999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.153724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.154181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.154602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.185888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c1ad3af-f56a-4cb5-b477-025d21654ee8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046429 Sep 06 12:03:53.186475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 986/2021] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:53.881213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:53.883756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:53.890197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.890687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.891120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.891810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.892259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.892793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.925204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0c9bcc5f-d1c0-4b02-9cb0-12d23f02729d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048616 Sep 06 12:03:53.927341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1036/2022] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:53.932798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:53.935015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:53.941608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.942134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.942601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.943338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:53.943794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:53.944222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:53.976097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-084c6217-8bc5-4e26-b706-87b4f0dfc7cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Sep 06 12:03:53.976988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 987/2023] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:54.151006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:54.153175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:54.159824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.160313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.160743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.161441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.161916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.162335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.194945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bdb6fa9f-3280-4cc0-add8-e94d3c9484a2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048915 Sep 06 12:03:54.196020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1037/2024] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:54.200285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:54.202513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:54.208635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.209124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.209600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.210342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.210800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.211792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.242765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1b10c62-16ff-432d-8c14-e5cfd5307236 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047862 Sep 06 12:03:54.243338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 988/2025] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:54.937692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:54.939914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:54.946646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.947332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.947780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.948506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.948966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.949394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.980256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1adf968b-ed9b-47c3-a2a1-03be2f250d99 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Sep 06 12:03:54.980822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1038/2026] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:54.988414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:54.990664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:54.997311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.997851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.998295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:54.998995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:54.999547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:54.999956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.031214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5e3508a2-ab0c-418f-a021-bfef1ef5183c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Sep 06 12:03:55.031788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 989/2027] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:55.208623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:55.210936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:55.217989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:55.218485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:55.218923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.219630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:55.220093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:55.220526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.224815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:55.254691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ff1e8bf-2e0b-480e-b39c-4b3b5829ee96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049980 Sep 06 12:03:55.255282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1039/2028] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:55.260164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:55.262934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:55.271034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:55.271599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:55.271975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.272696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:55.273156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:55.273579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:55.307563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-03334f75-fcc7-47ed-b2d4-be6f2d3618e0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055314 Sep 06 12:03:55.308603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 990/2029] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:55.993387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:55.995688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:56.003225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.003865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.004367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.005102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.005630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.006110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.040366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3d1e4d01-dd85-4e6b-87bb-0669d72d972e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051450 Sep 06 12:03:56.040954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1040/2030] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:56.044290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:56.046544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:56.048634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:03:56.048810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:03:56.049213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:56.049748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:56.056478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.056971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.057556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.058293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.058753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.059181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.061767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.062347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.062788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.063496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.063944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.064364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.097026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-16703f55-ac1f-4ea7-be4f-395c7f79cc52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057287 Sep 06 12:03:56.097800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 991/2031] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:56.145617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lazy-loading 'services' on Instance uuid 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:03:56.222487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41e7036b-413a-4d42-a52b-628f290224da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7/os-volume_attachments/606f4edf-b2eb-4dff-96cb-3c402e789d26" status: 202 len: 0 microversion: 2.1 time: 0.177009 Sep 06 12:03:56.223451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1041/2032] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 12:03:56 2022] DELETE /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7/os-volume_attachments/606f4edf-b2eb-4dff-96cb-3c402e789d26 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:03:56.276473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:56.279877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:56.287049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.287533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.287962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.288657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.289101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.289521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.321674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:56.323758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8882ff86-70a0-4205-b725-d21bc440643d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058029 Sep 06 12:03:56.324280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:56.324639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 992/2033] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:56.330842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.331331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.331804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.332520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:56.332979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:56.333412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:56.368465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efa234ec-cb8f-4273-8267-ff996cf20d1a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050898 Sep 06 12:03:56.369060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1042/2034] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:57.052727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:57.054922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:57.062860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.063347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.063790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.064505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.065658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.065658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.100632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e14d29e1-f762-4c25-83d0-b201f23e58d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051826 Sep 06 12:03:57.101216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 993/2035] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:57.108763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:57.110944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:57.117208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.118106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.118562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.119273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.119734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.120160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.153079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-60feb0fc-a10e-4db1-86be-e24cb299653b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Sep 06 12:03:57.153752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1043/2036] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:57.336809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:57.339092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:57.345066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.345509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.345994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.346703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.347639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.347639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.379370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3f2f9e4f-ed4f-4844-b3f7-1a6fa8e87d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Sep 06 12:03:57.379948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 994/2037] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:57.382678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:57.385511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:57.391561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.392054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.392496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.393200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:57.393679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:57.394110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:57.427040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21464dbf-8df4-4bb1-a287-8fca0e39e1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048903 Sep 06 12:03:57.427627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1044/2038] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:03:58.112612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:58.114936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:58.122545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.123039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.123484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.124199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.124657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.125089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.155156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-549510e9-b0c6-42bc-bde0-049796c83be7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Sep 06 12:03:58.155713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 995/2039] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:58.166026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:58.168211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:58.174887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.175367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.175798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.176519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.176996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.177413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.207344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c825dce2-c63d-4cc1-b22b-14a13473db4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Sep 06 12:03:58.207897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1045/2040] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:58.392403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:58.394594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:58.401473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.402033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.402469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.403214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.403854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.404332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.436029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c5e3cad1-ed19-413b-a2fa-eb7797839dd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Sep 06 12:03:58.436604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 996/2041] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:58.440587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:58.442755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:58.448639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.449116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.449544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.450274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:58.450723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:58.451143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:58.481190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c5a52778-9c18-48f2-8ccc-5fc01445d404 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044508 Sep 06 12:03:58.481775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1046/2042] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:03:59.168221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:59.170510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:59.177112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.177483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.177954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.178657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.179114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.179539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.209521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d0d38828-27dd-423f-9643-ad6a064ff219 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Sep 06 12:03:59.210110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 997/2043] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:59.219803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:59.221978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:59.228490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.228978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.229418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.230136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.230595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.231026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.262237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71e3e93c-e436-46c0-a0fe-cca89d1bacd9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Sep 06 12:03:59.267866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1047/2044] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:03:59.449384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:59.451633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:59.458359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.458848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.459284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.459993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.460445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.460867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.494044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:03:59.494638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-13dd819a-8419-43d6-a1be-1e6f8561acea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048433 Sep 06 12:03:59.495476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 998/2045] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:03:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:03:59.496300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:03:59.502408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.502899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.503347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.504052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:03:59.504505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:03:59.504930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:03:59.535873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b5dd87fe-29e6-4cd0-96a9-999f2c9b034a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046207 Sep 06 12:03:59.536448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1048/2046] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:03:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:00.222756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:00.224895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:00.231973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.232454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.232886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.233570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.234051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.234471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.238078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:00.264806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9ce814f-60e2-4711-8038-c9e532f3f9b7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Sep 06 12:04:00.265374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 999/2047] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:00.276115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:00.278350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:00.284750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.285231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.285685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.286379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.286833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.287256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.318094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73e2edfa-3875-4f48-bcb7-b928cb17a3bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Sep 06 12:04:00.318661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1049/2048] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:00.507042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:00.509854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:00.515728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.516205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.516639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.517323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.517796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.518213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.548585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:00.549898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b46180b-d418-470f-8d19-279cfbb729d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Sep 06 12:04:00.550469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1000/2049] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:00.550871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:00.557134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.557623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.558094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.558794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:00.559249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:00.559678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:00.589591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27c62aa6-9473-4c9a-9ddc-d3dc87cf551c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045013 Sep 06 12:04:00.590184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1050/2050] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:01.277084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:01.279255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:01.285891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.286372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.286801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.287489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.287928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.288383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.318411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c45723c-88ae-4309-92df-3053e67160c9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 06 12:04:01.318969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1001/2051] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:01.331221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:01.333454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:01.340853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.341342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.341814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.342508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.342962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.343386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.373841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2288ecfe-2f4a-4162-b19e-50e64d5f0bdd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Sep 06 12:04:01.374409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1051/2052] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:01.562726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:01.564895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:01.570814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.571864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.572312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.573013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.573457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.573902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.601675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:01.603405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8676a221-88b8-48ad-b2df-2e703a52a041 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Sep 06 12:04:01.604148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1002/2053] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:01.604495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:01.610606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.611092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.611534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.612230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:01.612721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:01.613149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:01.643625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-57744b08-41f1-4f01-8fd7-14dfb95946c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045830 Sep 06 12:04:01.644200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1052/2054] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:02.330501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:02.332800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:02.340512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.340760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.341140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.341932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.343156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.343156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.376366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c6a62af-4333-4d9b-9a5d-483587e58434 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049773 Sep 06 12:04:02.376947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1003/2055] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:02.387267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:02.389545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:02.396465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.397249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.397372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.398075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.398527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.399452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.440642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a1a390cd-2342-440d-9a80-ab028a833b04 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057324 Sep 06 12:04:02.441214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1053/2056] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:02.615891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:02.618244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:02.624180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.624669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.625118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.625850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.626310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.626738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.658422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:02.661241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:02.662324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22731c6d-f734-4cc2-9716-a04265a0802b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050458 Sep 06 12:04:02.667112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1004/2057] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:02.667402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.667884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.668640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.669350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:02.669835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:02.670255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:02.700058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3040f8fe-65c5-442b-8f40-7f352fa3fe24 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046912 Sep 06 12:04:02.700621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1054/2058] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:03.388693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:03.390853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:03.397622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.398132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.398569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.399866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.400022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.400445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.431352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2725699c-d2eb-4fd8-99ba-497907cb7941 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Sep 06 12:04:03.431930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1005/2059] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:03.452717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:03.454904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:03.461603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.462127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.462562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.463264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.463724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.464158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.468129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:03.497456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-32e609ba-6340-4371-94bd-ca0d5574cecf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048745 Sep 06 12:04:03.498080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1055/2060] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:03.675022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:03.677183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:03.683909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.684404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.684850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.685550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.686030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.686458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.713416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:03.715722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:03.716935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f79daea8-cf94-4b68-993a-5291b0ed5c18 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Sep 06 12:04:03.717887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1006/2061] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:03.721770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.722260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.722731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.723445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:03.723822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:03.724243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:03.754531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b68acc51-3ea4-4895-a8b2-46b26fca74f4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045751 Sep 06 12:04:03.755099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1056/2062] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:04.445463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:04.448839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:04.456585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.457086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.457562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.458304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.458770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.459208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.499830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1ea13123-473f-4133-a056-36608b98d158 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059273 Sep 06 12:04:04.501461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1007/2063] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:04.519279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:04.524954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:04.538965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.539543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.540419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.541329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.542039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.542630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.579962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1596a83d-47b9-4d0f-aa59-12ee8d82777b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068845 Sep 06 12:04:04.580562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1057/2064] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:04.730352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:04.732513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:04.738690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.739270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.739722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.740428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.740884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.741312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.769626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:04.773753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:04.774809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-325c3c35-9d70-4bea-a597-c3355abbaf47 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Sep 06 12:04:04.775414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1008/2065] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:04.781918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.782404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.782840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.783557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:04.784008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:04.784494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:04.815376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8963486b-accb-416c-b234-f870bc7e0f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051052 Sep 06 12:04:04.815939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1058/2066] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:05.516326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:05.518422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:05.525847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.526349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.526807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.527489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.527941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.528365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.558963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6c55b33e-9ed5-495b-97d8-96b86be22d25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046709 Sep 06 12:04:05.559542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1009/2067] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:05.593572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:05.595820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:05.602368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.602931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.603438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.604205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.604739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.605255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.637972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfa0eb12-1672-469b-9fb0-3736efece884 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048410 Sep 06 12:04:05.638574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1059/2068] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:05.787662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:05.789905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:05.796217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.796707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.797146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.797947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.798408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.798834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.828802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:05.830041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a7a4267-e7b2-4794-bf2b-491a39d08a9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Sep 06 12:04:05.830814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1010/2069] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:05.831721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:05.838874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.839366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.839796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.840494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:05.840944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:05.841365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:05.872136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a3fc2e3-9dfa-4336-b60d-4708b16975a1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047849 Sep 06 12:04:05.872717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1060/2070] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:06.572051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:06.574140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:06.581095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.581572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.582041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.582719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.583165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.583584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.617059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d30c542-c857-4cd0-941a-d6139e877fc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049152 Sep 06 12:04:06.618584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1011/2071] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:06.651387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:06.654169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:06.660988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.661482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.661962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.662680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.663139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.663570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.694571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a1598e01-96a5-48c3-915e-e583daa569a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048462 Sep 06 12:04:06.695136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1061/2072] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:06.843518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:06.845605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:06.851676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.853068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.853432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.854161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.854622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.855048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.885073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:06.886024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-53f07a85-51b9-486b-8197-fe3876f147b6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046493 Sep 06 12:04:06.886613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1012/2073] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:06.887249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:06.893469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.893996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.894437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.895137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:06.895596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:06.896279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:06.927516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2f9f7a5c-53de-40f7-b2c1-19c64bf9989a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046551 Sep 06 12:04:06.928120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1062/2074] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:07.630835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.632958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.640583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.641110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.641554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.642302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.642758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.643189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.674724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1635b044-ba9f-484f-81be-fd66cc164e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047932 Sep 06 12:04:07.675296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1013/2075] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:07.708197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.710377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.717526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.718117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.718625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.719406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.720003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.720503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.752369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b1b085f2-60b8-47ad-b91c-433a265226d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048817 Sep 06 12:04:07.752954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1063/2076] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:07.899171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.901602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.908367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.908932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.909426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.910311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.910815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.911286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.940238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:07.942392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:07.944110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e149589d-af82-4f51-bac1-f1b78beba33e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049459 Sep 06 12:04:07.949178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1014/2077] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:07.949409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.949409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.949749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.950363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:07.950819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:07.951355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:07.983298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6fad22f9-35fe-4cb7-8268-bccc2a5046c4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047004 Sep 06 12:04:07.983911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1064/2078] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:08.687467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:08.689683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:08.696286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:08.696770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:08.697211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:08.698465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:08.698944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:08.699351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:08.724835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:08.730169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a798e476-a1bc-45dc-ba0a-780f693d9e93 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046821 Sep 06 12:04:08.730737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1015/2079] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:08.765071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:08.767300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:08.774009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:08.774502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:08.774975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:08.776261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:08.776876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:08.777344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:08.806910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-66c81afc-b1f3-47a9-8c12-56188ab42989 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Sep 06 12:04:08.807481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1065/2080] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:08.957479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:08.959605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:08.965549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:08.966060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:08.966500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:08.967194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:08.967649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:08.968077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:08.997074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:08.997670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-26de3ab1-8158-4dd5-bc38-639cf918760d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Sep 06 12:04:08.998254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1016/2081] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:08.999358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:09.005256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.005779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.006222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.006920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.007387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.007816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.039329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-037067de-4d05-400f-bc8c-28881a955c96 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047179 Sep 06 12:04:09.039905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1066/2082] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:09.743052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:09.745204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:09.751373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.751857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.752298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.752993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.753450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.753910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.784051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e7d9372-08dc-4ef6-bd51-3da4bb223dc7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Sep 06 12:04:09.784626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1017/2083] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:09.822002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:09.825172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:09.828547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:09.836619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.837361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.838577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.839646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:09.840352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:09.840999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:09.875424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dd1aae2b-a932-417a-b421-0fa3114a6ff7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059805 Sep 06 12:04:09.875995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1067/2084] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:10.009965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:10.012134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:10.018579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.019070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.019497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.020190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.020645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.021320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.052633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5a772e53-99a3-43cc-abf6-d323ef28520f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Sep 06 12:04:10.052969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:10.053724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1018/2085] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:10.054904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:10.061341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.061908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.062357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.063072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.063527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.063956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.096828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8918f333-b37b-4424-a9bc-8256fd261e33 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048127 Sep 06 12:04:10.097422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1068/2086] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:10.797451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:10.799897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:10.805887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.806366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.807877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.808595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.809054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.809479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.840270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f4657b3c-55bd-4e1d-a201-82be4db55cfe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046727 Sep 06 12:04:10.840837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1019/2087] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:10.887756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:10.889956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:10.897069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.897561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.898026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.898741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:10.899200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:10.899624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:10.931449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34b5ba96-2f88-45e9-88be-552199feaafa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047924 Sep 06 12:04:10.932907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1069/2088] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:11.065632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:11.067706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:11.074097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.074575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.075005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.075683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.076127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.076542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.106822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d72a5c11-64fc-4091-b361-5bc2f14b385c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Sep 06 12:04:11.107393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1020/2089] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:11.110106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:11.112250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:11.118268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.118756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.119939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.120562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.121020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.121451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.152081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1cf5f67-7f80-49e8-9a7e-57aadad0df46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045918 Sep 06 12:04:11.153898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1070/2090] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:11.852605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:11.854963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:11.861063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.861543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.862015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.862728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.863176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.863607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.895872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-28d392ac-ff50-4c86-80ae-639e898869ea tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047159 Sep 06 12:04:11.896692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1021/2091] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:11.944645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:11.946848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:11.954262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.954758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.955203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.955915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:11.956373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:11.956802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:11.983491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:11.989007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-78bdf02a-f2be-4f22-9da3-aa3353789582 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048278 Sep 06 12:04:11.989673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1071/2092] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:12.118557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:12.121118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:12.127815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:12.128297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:12.128934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:12.129421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:12.130024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:12.130320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:12.161616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9dd744c-2ed4-460c-a56b-bd8a558133cd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047050 Sep 06 12:04:12.162285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1022/2093] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:12.165871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:12.168372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:12.174648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:12.175161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:12.175592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:12.176296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:12.176751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:12.177175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:12.213256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92c6366f-8d07-4056-9b57-b9a7f1c743b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051946 Sep 06 12:04:12.214094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1072/2094] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:12.909404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:12.911648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:12.918633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:12.919119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:12.919548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:12.920246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:12.920723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:12.921141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:12.953089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-85984441-d40e-4734-a715-2a7cc03a43e1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047639 Sep 06 12:04:12.953699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1023/2095] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:13.001412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:13.003376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:13.010179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.010702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.011082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.011787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.012772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.012772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.044893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6737bdcb-d36d-4826-af73-88509300d342 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Sep 06 12:04:13.045465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1073/2096] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:13.174595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:13.176926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:13.183962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.184447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.184891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.185600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.186158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.186585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.219418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9947b2e-e0af-4e9a-ad1b-b7447a70ea8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048904 Sep 06 12:04:13.220006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1024/2097] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:13.227186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:13.229359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:13.235479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.235967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.236411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.237112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.237563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.238016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.271840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6d95f6c6-1c00-4bdc-a4fe-f1c3175b1d0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049718 Sep 06 12:04:13.272430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1074/2098] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:13.965931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:13.968096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:13.974217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.974692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.975131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:13.975821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:13.976266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:13.976681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.008740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-df386899-a6d5-4ec3-a9ce-163fdceb5de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046949 Sep 06 12:04:14.009321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1025/2099] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:14.057542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:14.060228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:14.068425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:14.069030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:14.069474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.070396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:14.070937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:14.071411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.107608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4f668adc-891c-4d2a-85e7-d929fe5d0051 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054646 Sep 06 12:04:14.108312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1075/2100] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:14.285577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:14.287957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:14.295388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:14.295885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:14.296322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.297049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:14.297530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:14.297981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.312183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:14.315359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:14.321462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:14.321975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:14.322439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.323453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:14.323608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:14.323988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:14.331163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc86cf05-6da9-4dac-b9f9-7b8482653658 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049680 Sep 06 12:04:14.331951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1076/2101] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:14.358828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-652bf21d-7094-409a-83bb-89d871359920 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130817 Sep 06 12:04:14.359436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1026/2102] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:15.021834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:15.024119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:15.030545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.032079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.032079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.032079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.032539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.034129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.070617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d92b9195-d6c8-4b79-a611-b7774cf3d01e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052902 Sep 06 12:04:15.071207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1077/2103] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:15.121523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:15.123723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:15.125829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:15.132199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.132922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.133362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.134734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.135707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.136135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.170377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ce325c4-786f-46e2-a2c8-27751178f740 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053409 Sep 06 12:04:15.171041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1027/2104] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:15.343712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:15.345961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:15.352338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.352834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.353274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.354806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.355274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.355709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.372864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:15.375393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:15.383202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.383692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.384133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.384892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:15.385355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:15.385822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:15.390031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-02da9626-f843-4acf-beca-d8a2c68e7009 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050327 Sep 06 12:04:15.390951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1078/2105] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:15.419818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12641e69-15c8-4718-b736-b7dec47dd210 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052069 Sep 06 12:04:15.420408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1028/2106] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:16.084283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:16.086473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:16.093844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.094338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.094779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.095482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.095938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.096366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.128327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c124ce3-8378-468c-b19c-fce62394a890 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Sep 06 12:04:16.128910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1079/2107] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:16.183820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:16.186046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:16.192612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.193093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.193522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.194243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.194689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.195109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.237030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc8817eb-faf4-4746-9f6f-62a70b105bda tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057266 Sep 06 12:04:16.237618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1029/2108] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:16.403642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:16.405839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:16.412457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.412950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.413386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.414136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.414591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.415044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.434355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:16.437266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:16.449749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.450930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.451824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.452946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:16.453945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:16.454805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:16.496752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2962258c-3bb2-4d50-bda3-0972b9d51a07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064455 Sep 06 12:04:16.499048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1030/2109] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:16.612136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5860a27d-5b45-4ea8-9b7a-4fcbc808d1eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.213197 Sep 06 12:04:16.612736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1080/2110] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:17.141298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:17.143559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:17.151119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.151775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.152226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.152947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.153407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.153879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.188786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ad6459f8-1e1c-4bda-9f4e-11dc38461fa9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051483 Sep 06 12:04:17.189380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1031/2111] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:17.250550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:17.252974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:17.260855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.261386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.261862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.262587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.263050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.263478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.298516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dee7c069-60fc-48c2-97bc-910d93dc7f5c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051974 Sep 06 12:04:17.299113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1081/2112] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:17.507010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:17.509499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:17.516666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.517161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.517610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.518352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.518811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.519240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.538595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:17.553299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b34e073b-d799-46e7-b026-3bc5f0f392fd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050278 Sep 06 12:04:17.553927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1032/2113] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:17.625816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:17.627634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:17.634588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.635773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.636250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.636950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:17.637401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:17.637870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:17.671873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a34a898-cb48-408b-aa99-d2b887f425c2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050824 Sep 06 12:04:17.672564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1082/2114] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:18.201702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:18.203939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:18.210791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.211595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.212141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.212873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.213324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.213794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.247436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-24ce94c9-3592-4130-b8b5-f8dcd90fd4dd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050516 Sep 06 12:04:18.248326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1033/2115] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:18.312911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:18.315159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:18.322214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.322754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.323201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.323924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.324415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.324852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.359883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea7bc88f-1b2d-474c-bb67-c8ee71d8ab0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051490 Sep 06 12:04:18.360650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1083/2116] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:18.566301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:18.568725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:18.576901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.577404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.577883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.578600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.579065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.579491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.614079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62670fb5-035f-417f-bb02-8e37c0d52295 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051689 Sep 06 12:04:18.614570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1034/2117] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:18.691004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:18.695973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:18.704376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.705172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.705838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.706739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:18.707362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:18.707966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:18.753817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0275703f-e8ad-43bd-a079-57a4bab808f6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072322 Sep 06 12:04:18.754414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1084/2118] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:19.267654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:19.271699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:19.283545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.284410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.285192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.286444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.287301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.288075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.346213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f009f8de-8ee0-4186-bf50-ad0a79c45220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086083 Sep 06 12:04:19.347138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1035/2119] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:19.376598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:19.380058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:19.391116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.391839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.392487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.393543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.394405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.395142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.453023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4cabcd3b-161e-4e9c-bb63-c399dd34bea1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083699 Sep 06 12:04:19.459364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1085/2120] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:19.631038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:19.633193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:19.641545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.642073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.642518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.643237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.643702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.644127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.680972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-251a6254-b380-49f4-8c9f-8d9446bee077 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054315 Sep 06 12:04:19.681619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1036/2121] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:19.767199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:19.769412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:19.777006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.777502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.777985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.778695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:19.779163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:19.779588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:19.816249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8efc75f7-c0e6-432b-ba5d-f9e48e34b8a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053265 Sep 06 12:04:19.816828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1086/2122] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:20.361005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:20.363252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:20.370325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.370822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.371268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.371981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.372441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.372868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.406125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e68c00dc-b0da-48eb-bd1c-95094141b9da tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049019 Sep 06 12:04:20.406719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1037/2123] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:20.468290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:20.470619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:20.477792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.478469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.479440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.480158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.480619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.481086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.514599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5c2f613a-3a2d-4a21-802e-6f6f8b15834b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050255 Sep 06 12:04:20.514942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1087/2124] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:20.694248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:20.696462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:20.703855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.704361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.704799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.705503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.705986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.706410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.738613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-873b849b-d23d-446e-a8a2-f90059e91da1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Sep 06 12:04:20.739195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1038/2125] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:20.829980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:20.832844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:20.840949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.841447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.844787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.844787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:20.844787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:20.844787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:20.862932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:20.877872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-698ed690-0c04-4693-9a23-a280a7094c8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052641 Sep 06 12:04:20.878458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1088/2126] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:21.419597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:21.421964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:21.428854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.429431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.429911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.430714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.431198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.432369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.465367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e9652e30-69cb-4059-b953-b97a6a759cd2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050301 Sep 06 12:04:21.465991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1039/2127] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:21.528519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:21.530707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:21.537766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.538275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.538722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.539450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.539913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.540341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.588521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8456d2c9-7f21-48b4-bc8a-26c4a43626c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063960 Sep 06 12:04:21.589625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1089/2128] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:21.752017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:21.754438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:21.762192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.762698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.763142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.763896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.764363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.764792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.804263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e81e8ca-a0fb-4710-b144-b89e6ad8768f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056108 Sep 06 12:04:21.804755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1040/2129] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:21.892230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:21.894667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:21.902050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.902536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.903927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.903927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:21.904261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:21.904564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:21.940547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-45f197f0-7a90-4a43-97d2-72c8e61e4312 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053653 Sep 06 12:04:21.941133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1090/2130] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:22.477710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:22.481238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:22.488341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.488828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.489265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.490003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.490459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.490886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.527362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2fc082a-5c91-45e1-bb5e-7ce6fd7c9f86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053665 Sep 06 12:04:22.527869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1041/2131] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:22.605698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:22.607953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:22.614766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.615256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.615693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.616397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.616850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.617268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.655146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6758f49-1c59-49f9-8ac9-62502e6268b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054202 Sep 06 12:04:22.655752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1091/2132] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:22.817794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:22.819971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:22.827270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.827786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.828227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.828961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.829413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.829869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.864662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-da1862e4-24ca-40bd-960c-68e9fee083dc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050968 Sep 06 12:04:22.865256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1042/2133] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:22.954779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:22.956962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:22.962980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.963474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.963905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.964662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:22.965120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:22.965540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:22.997776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-496161fd-f270-4c6e-9e35-4ea32ec00f43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046916 Sep 06 12:04:22.998332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1092/2134] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:04:23.540053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:23.542741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:23.548660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:23.549138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:23.549567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:23.550319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:23.550769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:23.551183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:23.580575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-db6f5841-f6cd-44d8-b30a-6e319549f281 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044572 Sep 06 12:04:23.581132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1043/2135] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:23.667935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:23.670320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:23.679595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:23.680315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:23.680955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:23.682042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:23.682726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:23.683360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:23.718399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-befda6c6-41f3-4057-8cf9-f70cf8097047 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054991 Sep 06 12:04:23.718971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1093/2136] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:23.877580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:23.879797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:23.887264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:23.887747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:23.888186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:23.888884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:23.889336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:23.889794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:23.920460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d9d10ea6-16e7-47a6-8abe-bbc8f8250591 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Sep 06 12:04:23.921038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1044/2137] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:24.011343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:24.013626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:24.020254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.021452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.022178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.022626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.023045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.054732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1aec8b2b-cdc7-471a-9858-371b300cd5f7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048145 Sep 06 12:04:24.055301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1094/2138] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:24.593226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:24.595435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:24.601495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.602022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.602457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.603170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.604126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.604552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.638649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-355c19c7-ff4c-4cfc-9213-323cd42714b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Sep 06 12:04:24.639246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1045/2139] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:24.731822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:24.734062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:24.740845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.741340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.741812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.742516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.742978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.743406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.774963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b615204c-2934-43e9-ab39-c04b67908ba9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047806 Sep 06 12:04:24.776066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1095/2140] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:24.932984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:24.935242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:24.941891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.942381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.942821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.943532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:24.943988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:24.944413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:24.975767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c7df0d99-a571-48a8-8084-e68b2d29bba1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Sep 06 12:04:24.976425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1046/2141] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:25.067778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:25.069922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:25.076315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.076794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.077232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:25.077929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.078379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.078796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:25.109511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73e48d57-4990-4a11-b2b3-36b128a26e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045691 Sep 06 12:04:25.110388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1096/2142] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:25.651919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:25.654121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:25.660121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.660595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.661038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:25.661766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.662228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.662658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:25.695145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d7a25ed0-bfe8-475e-ba61-f2c1a9cc4daf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047619 Sep 06 12:04:25.695720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1047/2143] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:25.787846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:25.790047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:25.797155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.797663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.798115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:25.798807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.799266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.799692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:25.830125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e0d52c5a-a44c-4dec-b5cc-a63e9e15f774 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046185 Sep 06 12:04:25.830693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1097/2144] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:25.989390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:25.991663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:25.998817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:25.999308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:25.999749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.000471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.000933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.001372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.030902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1496fed-5445-4838-ba89-34a318e8f678 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 Sep 06 12:04:26.031522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1048/2145] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:26.126859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:26.129049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:26.135203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.135694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.136290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.136982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.137431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.137882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.171358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9617476-ed94-47ac-9bb9-6ba94a75fa1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048360 Sep 06 12:04:26.172748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1098/2146] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:26.708582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:26.710829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:26.717936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.718422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.718886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.719577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.720030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.720453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.724129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:26.752484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74b4759a-a9d9-42f0-be32-aaa4a535941f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Sep 06 12:04:26.753070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1049/2147] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:26.843304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:26.845499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:26.851695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.852176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.852615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.853323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:26.853814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:26.854241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:26.884166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c62f9d37-4051-4de0-ad57-6dd0b6d0c170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Sep 06 12:04:26.885234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1099/2148] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:27.044323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:27.046424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:27.052770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.053257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.053724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.054428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.054880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.055327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.086908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b3cbff2-620d-4f85-91a8-a3c033a41aed tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Sep 06 12:04:27.087469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1050/2149] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:27.185337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:27.187594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:27.193850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.194350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.194796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.195501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.195959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.196387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.227172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a044ec43-efd7-4c13-bc32-de636fae80fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046557 Sep 06 12:04:27.227733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1100/2150] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:27.765204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:27.767375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:27.773636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.774138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.774570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.775794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.776291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.776702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.807008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1d092ba-597c-4117-a700-6b45c6600ff5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Sep 06 12:04:27.808005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1051/2151] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:27.898521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:27.901298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:27.907887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.908379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.908820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.909511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:27.909994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:27.910422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:27.940320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d33dd82e-c56a-4726-bc3e-504e747f3b8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Sep 06 12:04:27.940880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1101/2152] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:28.099860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:28.101930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:28.108590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.109076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.109507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.110231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.110681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.111100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.141363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-112a745a-93f1-440c-99a0-73a328c87c0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Sep 06 12:04:28.141989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1052/2153] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:28.239842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:28.242195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:28.254076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.254373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.254820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.255523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.256014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.256438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.287935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36c31b80-7220-47d5-9b1a-bdde91a7afa8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052056 Sep 06 12:04:28.288512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1102/2154] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:28.820234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:28.822502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:28.828599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.829089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.829531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.830259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.830716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.831150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.861009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-adf272f6-04b0-4cbb-9d27-f2df3cfa3383 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Sep 06 12:04:28.861577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1053/2155] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:28.952990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:28.955176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:28.961616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.962084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.962521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.963333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:28.963794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:28.964224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:28.994501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc323fee-350e-46b8-ad65-ba299d4d5592 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Sep 06 12:04:28.995109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1103/2156] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:29.154488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:29.156683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:29.163054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:29.163535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:29.163973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:29.164660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:29.165113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:29.165542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:29.195127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0542f0af-d8f0-44c2-897d-d54a92981b27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 Sep 06 12:04:29.195692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1054/2157] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:29.300712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:29.302899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:29.309759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:29.310246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:29.310683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:29.311378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:29.311820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:29.312244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:29.344197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-daa5910c-d0b3-4f48-b5bf-50f7a6145f7d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047442 Sep 06 12:04:29.344775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1104/2158] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:29.872861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:29.875109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:29.881268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:29.881790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:29.882232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:29.882932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:29.883389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:29.883816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:29.917519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc2eea58-28dd-4169-b2f1-6294161d95ab tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048738 Sep 06 12:04:29.918159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1055/2159] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:30.006619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:30.008865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:30.016225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.016717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.017157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.017896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.018362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.018789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.022810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:30.049432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3f7225d-6261-40c2-9090-586f311436fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Sep 06 12:04:30.050054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1105/2160] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:30.207216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:30.209390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:30.215770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.216254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.216694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.217384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.217879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.218307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.247402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac127248-c1c3-47fd-9f3c-6ebdd01b87bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Sep 06 12:04:30.248005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1056/2161] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:30.357471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:30.359711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:30.365715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.366211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.366652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.367350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.367806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.368233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.399255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-07877b9f-a264-48cd-aac3-68cbd6c6e5a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046278 Sep 06 12:04:30.399864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1106/2162] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:30.930219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:30.932383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:30.938560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.939043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.939481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.940173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:30.940630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:30.941053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:30.970845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3562feb9-185b-47f8-a897-fcd7c25f4c60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Sep 06 12:04:30.971477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1057/2163] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:31.061968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:31.064185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:31.070799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.071285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.071723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.073627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.074120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.074547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.106933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-83f4ed3d-1f29-4a1b-bd09-72a27d593ebb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048933 Sep 06 12:04:31.107510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1107/2164] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:31.259183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:31.262560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:31.269098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.269586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.270134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.270833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.271542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.271967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.304841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37a47588-8663-442f-84ba-46ed73fb773b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049527 Sep 06 12:04:31.305425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1058/2165] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:31.411442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:31.413658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:31.420324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.420819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.421262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.422006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.422460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.422903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.457486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9563171-fa66-4d23-a63f-d2a2b38081aa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050079 Sep 06 12:04:31.458111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1108/2166] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:31.985336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:31.987520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:31.993613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.995536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.996003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:31.996774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:31.997221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:31.997685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.030170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b05cc8c-97af-4843-b799-870774d802c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Sep 06 12:04:32.030791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1059/2167] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:32.121146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:32.123375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:32.129976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:32.130463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:32.130900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.131588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:32.132039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:32.132454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.162905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88ed0a5e-de52-4f69-b05c-6caa69a5d77b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Sep 06 12:04:32.163459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1109/2168] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:32.318071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:32.320224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:32.327898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:32.328392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:32.328840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.329774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:32.330118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:32.330695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.363956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09258379-21f5-4654-861d-d8067d22865e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049939 Sep 06 12:04:32.364542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1060/2169] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:32.472910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:32.475095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:32.481121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:32.481606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:32.482086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.482779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:32.483224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:32.483647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:32.516581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-47ea8a9e-5562-4b6b-a5e9-8887e277ceab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047604 Sep 06 12:04:32.517208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1110/2170] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:33.043976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:33.046183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:33.052223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.052712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.053157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.053883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.054343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.054771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.084076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22c4c2ae-e9ea-43e0-92e7-ef10212a3869 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Sep 06 12:04:33.084712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1061/2171] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:33.176235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:33.178440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:33.185214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.185801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.186245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.186958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.187411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.187836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.219443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a0900fba-1bb7-4224-a606-0297792e9df5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047151 Sep 06 12:04:33.220026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1111/2172] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:33.378067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:33.380247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:33.387463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.387956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.388397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.389091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.389544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.390002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.422126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-40be36c0-98cc-4c96-8858-e2d4e51dc37d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048469 Sep 06 12:04:33.422737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1062/2173] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:33.530542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:33.532717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:33.538749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.539208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.539640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.540327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:33.540858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:33.541354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:33.572457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-38668f8b-b548-4981-8f11-65d56ebd74be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045574 Sep 06 12:04:33.573532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1112/2174] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:34.097328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:34.099530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:34.106120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.106612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.107054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.107746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.108204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.108630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.141728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-84e6b046-6c10-4e31-a9b2-e84bc2889f05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048432 Sep 06 12:04:34.142295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1063/2175] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:34.232804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:34.234991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:34.241546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.242066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.242595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.243278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.243812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.244848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.275116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c56f1ffd-06fd-4b1d-8d4b-daa3366de48a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046933 Sep 06 12:04:34.275783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1113/2176] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:34.434895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:34.437036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:34.443413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.443897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.444335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.445019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.445466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.445920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.476247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6cb3f425-197b-412e-96c5-fe0070d99e8c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Sep 06 12:04:34.476802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1064/2177] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:34.584666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:34.586856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:34.600162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.600651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.601086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.601819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:34.602272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:34.602695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:34.638726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eb11e109-138f-4cea-b4d7-7da2ce640dae tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058001 Sep 06 12:04:34.639625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1114/2178] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:35.155144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:35.157301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:35.163350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.163840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.164282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.164974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.165431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.165891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.191390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:35.196356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3bd93202-c53d-48ae-aa01-00bb1fbfd828 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Sep 06 12:04:35.196979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1065/2179] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:35.287708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:35.289912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:35.296623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.297114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.297552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.298274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.298729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.299159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.329840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5b1818a3-6c36-4114-abb3-6bf37f823d15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Sep 06 12:04:35.330402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1115/2180] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:35.490579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:35.492778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:35.500960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.501458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.501933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.502682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.503139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.503563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.537898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a259ecbe-3f60-455b-95cd-62ee6ac65a0c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051571 Sep 06 12:04:35.538470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1066/2181] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:35.651738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:35.654019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:35.660170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.660654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.661527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.661799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:35.662246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:35.662665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:35.694914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21b00221-25e1-4aec-838c-bca0a2fa791b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047177 Sep 06 12:04:35.695481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1116/2182] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:36.210133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:36.213036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:36.219242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.219727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.220163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.220875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.221331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.221794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.254295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4c857142-13a8-4ae8-bae7-55a53c4efce8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048666 Sep 06 12:04:36.254906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1067/2183] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:36.343347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:36.345427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:36.347845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:36.353088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.353625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.354096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.354798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.355260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.355687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.385551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5b96b695-fdf6-45c8-9fe8-0854187a9712 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Sep 06 12:04:36.386140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1117/2184] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:36.551607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:36.553794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:36.560473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.560955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.561394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.562122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.562579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.563009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.593633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e5af147d-4f2f-40cf-ba1d-16dc0f815a0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045859 Sep 06 12:04:36.594172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1068/2185] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:36.707727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:36.709960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:36.716197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.716683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.717122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.717846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:36.718328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:36.718754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:36.750222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa4a1e23-a486-4abc-ab31-13ff4856fcd9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046481 Sep 06 12:04:36.750989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1118/2186] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:37.268252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:37.270445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:37.277475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.277987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.278430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.279122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.279582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.280015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.309435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bb999b2b-4202-4dec-8eb4-db8e37c6ad7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Sep 06 12:04:37.310030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1069/2187] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:37.398563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:37.401354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:37.407942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.408429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.408869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.409572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.410058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.410490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.442684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aae28f70-d607-4712-9145-e6450b697221 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048252 Sep 06 12:04:37.443266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1119/2188] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:37.606924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:37.608977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:37.615365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.615843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.616281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.616959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.617412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.617873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.650119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-576ff81b-085e-4018-a10f-776110138dea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 Sep 06 12:04:37.651320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1070/2189] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:37.763321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:37.765505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:37.771749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.772235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.772677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.773363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:37.773850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:37.774277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:37.803790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3130ad27-e911-40c1-ac4b-311ec0632fe5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045068 Sep 06 12:04:37.804346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1120/2190] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:38.322039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:38.324229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:38.330489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.331172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.331737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.332603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.333164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.334042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.364370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c592ca0-fa80-4ef6-8e39-35df9693149a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046472 Sep 06 12:04:38.364930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1071/2191] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:38.456076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:38.458310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:38.465620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.466117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.466560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.467256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.467714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.468143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.493429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:38.498742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e12c57d-8fc2-4dd5-b069-a409c3b5d734 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046724 Sep 06 12:04:38.499308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1121/2192] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:38.663721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:38.666440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:38.673441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.674236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.675008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.676115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.676689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.677179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.714973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a35a2d70-1d79-4f14-a778-38e7ba0a8e32 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055480 Sep 06 12:04:38.715549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1072/2193] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:38.816967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:38.819072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:38.825336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.825863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.826305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.826994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:38.827450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:38.827875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:38.858442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f904ebff-f129-49ff-8127-53fa30d5bcac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045571 Sep 06 12:04:38.859004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1122/2194] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:39.376956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:39.379168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:39.385328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.385854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.386296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.386986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.387443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.387869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.418148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-973ef91b-cd20-4902-8c9d-ec5ab5b79741 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045161 Sep 06 12:04:39.418715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1073/2195] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:39.512030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:39.514187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:39.521063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.521807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.522255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.522969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.523423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.523841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.553604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc39a997-889a-4b6d-9c9f-7ccf8c1e4e5a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Sep 06 12:04:39.554178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1123/2196] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:39.727977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:39.730946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:39.737099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.737595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.738059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.738807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.739215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.739961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.770611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f50519f9-0df8-4c2e-8686-51c1535d7fc1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Sep 06 12:04:39.771109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1074/2197] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:39.876685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:39.880002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:39.885693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.886189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.886633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.887326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:39.887781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:39.888209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:39.918424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-69f3928c-c802-44ed-bb45-8d2c56215220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045780 Sep 06 12:04:39.918992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1124/2198] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:40.430726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:40.433476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:40.439949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.440437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.440877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.441566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.442059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.442487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.471942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81e0eff5-274c-4ce9-ac5b-74c586639267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Sep 06 12:04:40.472505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1075/2199] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:40.567022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:40.569065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:40.576159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.576644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.577090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.577806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.578268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.578697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.608153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-126a8bf2-343b-4cf9-835e-0a59ecd7bb1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Sep 06 12:04:40.608662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1125/2200] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:40.784090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:40.786280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:40.793149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.793624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.794089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.794776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.795231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.795656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.825207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-777c34fa-7468-4a6b-8c7f-335254e26a5f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Sep 06 12:04:40.825810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1076/2201] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:40.932073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:40.934322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:40.941333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.941960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.942503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.943317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:40.943848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:40.944318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:40.980494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6847cc79-22c6-4094-b867-5d54f61c631a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053206 Sep 06 12:04:40.981157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1126/2202] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:41.485141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:41.487413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:41.489900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:41.495992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.496482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.496924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.497623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.498103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.498528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.528989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc9f0374-7986-4a06-b1b2-443c2894ffd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Sep 06 12:04:41.529481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1077/2203] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:41.620495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:41.622748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:41.629257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.629786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.630232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.630926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.631382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.631809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.663077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ddb43c4a-8dfc-45d0-8385-c2bebd0022e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Sep 06 12:04:41.663635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1127/2204] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:41.838264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:41.840414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:41.846423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.846910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.847350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.848066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:41.848528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:41.848956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:41.877602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ee23701-9bbd-4225-a0c5-0267b120f2c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Sep 06 12:04:41.878196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1078/2205] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:41.994335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:41.996634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:42.002759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.003250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.003692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.004389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.004840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.005265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.009892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:42.012670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:42.018904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.019392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.019827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.020662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.021120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.021933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.036643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d4ba12a2-b8e1-435b-8a99-235f7962fad9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046798 Sep 06 12:04:42.037218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1128/2206] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:42.053908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9dba8f58-05a9-4978-b249-ed8c249cc137 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048408 Sep 06 12:04:42.054470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1079/2207] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:42.540610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:42.542838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:42.548735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.549216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.549669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.550342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.550788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.551209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.580782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5cb82dba-3ae4-49bc-9fa2-d2ea3f0f7958 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Sep 06 12:04:42.581362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1129/2208] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:42.675740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:42.677923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:42.684973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.685457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.685922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.686622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.687078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.687507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.717306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0be76969-276f-4eb7-9f76-af8754feebfd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Sep 06 12:04:42.717913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1080/2209] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:42.891223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:42.893310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:42.900104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.900676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.901118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.901833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:42.902291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:42.902715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:42.932381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9cdd7415-b3ed-42cb-b9cb-402af85f8b30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Sep 06 12:04:42.932947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1130/2210] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:43.049963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:43.052173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:43.058969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.059454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.059889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.060577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.061036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.061465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.067543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:43.069722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:43.075866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.076360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.076803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.077505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.078000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.078430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.091452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20c8789e-b88b-4915-be05-6e8a1d43fb86 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045475 Sep 06 12:04:43.092044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1081/2211] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:43.108743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-93d6ae7b-2943-4caf-8b87-21c1acea12bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Sep 06 12:04:43.109312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1131/2212] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:43.593339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:43.595571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:43.601528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.602048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.602488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.603779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.604239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.604662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.622425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:43.635579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8a7e5738-06ba-4efb-b36e-243df5c9090f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046250 Sep 06 12:04:43.636166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1082/2213] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:43.730382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:43.732559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:43.738611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.739088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.739516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.740188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.740634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.741050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.769828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a177f54-d845-4399-949d-786166159dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Sep 06 12:04:43.770379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1132/2214] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:43.944848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:43.947522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:43.954104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.954596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.955036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.955737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:43.956195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:43.956621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:43.987585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74c72b87-c88f-490e-aba8-faf4c0eca27d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Sep 06 12:04:43.988156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1083/2215] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:44.104914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:44.107133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:44.113546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.115655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.116119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.116843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.117313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.117778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.120598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:44.123383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:44.129253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.129805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.130335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.131120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.131488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.131911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.153076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-33cb40d9-7967-4a8b-b1eb-eba1034b2f0e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052749 Sep 06 12:04:44.153683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1133/2216] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:44.164027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8f2789a2-e8b6-488a-9761-01369299294e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Sep 06 12:04:44.164583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1084/2217] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:44.648656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:44.651455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:44.659389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.660122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.660804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.661934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.662600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.663236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.706686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb8fc1be-719e-4fea-80a3-4ba14f2084f1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062351 Sep 06 12:04:44.707276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1134/2218] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:44.783506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:44.785755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:44.792204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.792687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.793126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.793970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:44.794542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:44.795055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:44.824636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de70413f-d24b-4f28-9407-d1e55e915e4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Sep 06 12:04:44.825188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1085/2219] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:45.000420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:45.002592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:45.008490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.008963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.009449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.010099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.010551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.010968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.044554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-62f448d1-c682-4b36-b205-20cb928184d5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047990 Sep 06 12:04:45.045119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1135/2220] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:45.166859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:45.169022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:45.175559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.176037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.176401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:45.176845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.177137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.177583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.178032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.178589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:45.185116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.185629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.186102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.186799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.187257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.187683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.207545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-55dc6934-c628-4684-b4b6-f4e84d4fad2b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045283 Sep 06 12:04:45.208119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1086/2221] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:45.218695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-04f8e735-5705-4c81-a25e-02c3d1dbbf7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Sep 06 12:04:45.219268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1136/2222] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:45.718973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:45.721192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:45.727293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.727829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.728309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.729133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.729591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.730125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.772825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6079b44a-4b98-4d25-af3d-291d2bdf0a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057866 Sep 06 12:04:45.773394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1087/2223] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:45.837129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:45.839479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:45.845709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.846202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.846646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.847334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:45.847792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:45.848222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:45.877306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-59a0b031-615d-4740-89c9-2b06b4e3d295 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Sep 06 12:04:45.877897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1137/2224] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:46.057999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:46.060073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:46.066088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.066570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.067004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.067689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.068148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.068566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.098335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4de2dbea-a22f-4626-b709-4b4f39ff5b36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Sep 06 12:04:46.098893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1088/2225] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:46.220684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:46.222870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:46.230669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.231151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.231492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:46.231922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.232252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.232701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.233117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.233686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:46.240542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.241172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.241618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.242346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.242806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.243234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.252340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:46.265976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6195f51f-d4a8-4e48-9b87-557f04f12e70 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049191 Sep 06 12:04:46.266568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1138/2226] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:46.276561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a15ad71d-dbdc-4769-be16-c5373794aef9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049459 Sep 06 12:04:46.277124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1089/2227] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:46.785483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:46.787767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:46.794674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.795138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.795579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.796269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.796717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.797133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.827773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-119c0301-7f4d-4ebe-a28e-6ca5990bc72a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Sep 06 12:04:46.828350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1139/2228] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:46.890286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:46.892502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:46.898896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.899379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.899876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.901673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:46.902125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:46.902552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:46.934853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-923e691f-30c7-4f9d-8cc6-8a792747bcf8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048431 Sep 06 12:04:46.935443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1090/2229] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:47.111498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:47.113622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:47.119693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.120179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.120620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.121346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.121845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.122277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.152543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-425ca389-b78c-4318-be56-30b78638012e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Sep 06 12:04:47.153114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1140/2230] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:47.278713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:47.280839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:47.287340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.287744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.288179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.288870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.289194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:47.289602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.289828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.291664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:47.298165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.298632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.299071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.299769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.300226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.300652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.322337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b2a2b1c0-42f3-45bc-8a30-8fe7acb6379f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047084 Sep 06 12:04:47.322924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1091/2231] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:47.333506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-01e2160b-e483-41af-81c4-aee5dd82f2a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048452 Sep 06 12:04:47.334279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1141/2232] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:47.840215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:47.842368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:47.848261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.848738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.849169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.849880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.850351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.850767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.880365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62b672c3-91c5-4b09-ae99-4f432354c1b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Sep 06 12:04:47.880912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1092/2233] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:47.947579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:47.949775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:47.955967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.956457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.956907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.957592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:47.958093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:47.958496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:47.991107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-22b4ac9f-a475-42aa-bc03-0e1aa1a267e3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Sep 06 12:04:47.991675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1142/2234] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:48.165125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:48.168308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:48.174120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.174613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.175052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.175750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.176203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.176630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.208352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d2984c7b-11b9-47ca-935a-0d980e5be914 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047159 Sep 06 12:04:48.208918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1093/2235] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:48.335137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:48.338048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:48.344974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.345461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.345946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.346643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.346990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:48.347445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.347556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.349147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:48.355571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.356048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.356483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.357168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.357618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.358065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.378341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a40f4ab-1ab9-4e45-a226-8002f2d84407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047157 Sep 06 12:04:48.378916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1143/2236] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:48.388220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-197ba4b1-9420-4361-8688-51db2e3bd540 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Sep 06 12:04:48.388786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1094/2237] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:48.892658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:48.894755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:48.901347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.901878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.902319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.903005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:48.903461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:48.903885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:48.933708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-790d9f28-8a78-4934-88b7-c870af10fa3a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Sep 06 12:04:48.934271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1144/2238] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:49.003573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:49.005800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:49.012430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.012916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.013357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.014084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.014542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.014970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.045585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e116cdce-c9c2-45d2-84df-9f020c7a8db4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045911 Sep 06 12:04:49.046176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1095/2239] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:49.220669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:49.222870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:49.229039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.229529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.229997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.230701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.231155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.231577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.263995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e3634dc-dc47-4f00-9abf-9e06913e15e8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047269 Sep 06 12:04:49.264582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1145/2240] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:49.391574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:49.393725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:49.400702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.401181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.401615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.401799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:49.402309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.402752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.403170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.404012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:49.410426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.410926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.411348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.412039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.412494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.412916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.435745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f81c061c-e0b2-4d6e-881a-23bc98677bd6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048124 Sep 06 12:04:49.436396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1096/2241] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:49.449314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-43a8e7d4-dd64-4574-a435-85c58347d7a5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052851 Sep 06 12:04:49.449904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1146/2242] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:49.948296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:49.950485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:49.957688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.958182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.958610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.959300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:49.959744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:49.960158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:49.990530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1e9d481f-f361-406b-8a2d-bf0f5bdb8206 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Sep 06 12:04:49.991204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1097/2243] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:50.058269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:50.060471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:50.066551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.066980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.067423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.068120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.068578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.069010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.101131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea33a1a0-4253-4011-8199-7f3da62dc085 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046573 Sep 06 12:04:50.101744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1147/2244] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:50.277024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:50.279276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:50.285123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.285608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.286065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.286739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.287187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.287604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.317666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3fbe598a-21dd-450e-91bf-8353b21dd7be tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Sep 06 12:04:50.318240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1098/2245] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:50.448840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:50.451131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:50.457865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.458360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.458792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.459491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.459938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.460355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.462972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:50.465299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:50.471821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.472303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.472741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.473432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:50.473912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:50.474336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:50.478313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:50.495434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-950803c0-3ce5-496a-be2d-f402e5ceb3e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051079 Sep 06 12:04:50.496020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1148/2246] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:50.505542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d12b21e1-9c53-4bb0-b026-22b045512562 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Sep 06 12:04:50.506074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1099/2247] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:51.004383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:51.006574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:51.012556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.013040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.013482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.014198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.014656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.015085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.046953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b983b6ec-d935-4d67-9d8d-6d2ba054eacf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 Sep 06 12:04:51.047525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1149/2248] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:51.113880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:51.116030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:51.122134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.122615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.123049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.123730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.124187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.124610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.155324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-17d69ab7-e933-4804-9107-dedd3c13f344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Sep 06 12:04:51.155897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1100/2249] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:51.331294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:51.333462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:51.340543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.341034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.341504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.342235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.342705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.343119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.372593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a575ade-2a17-446e-81b5-7e0919163e48 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Sep 06 12:04:51.373171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1150/2250] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:51.508978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:51.511654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:51.518639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.519129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.519316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:51.519828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.520237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.520684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.521102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.521474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:51.530037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.530537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.531014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.531724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:51.532183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:51.532612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:51.555650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d674733-2b6f-4dfb-b08e-e8daae7796c8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050539 Sep 06 12:04:51.556699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1101/2251] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:51.564387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-95fc42ed-14cd-4b1d-b9a9-899a03d61219 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049139 Sep 06 12:04:51.564949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1151/2252] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:52.060225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:52.062460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:52.068414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.068900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.069340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.070060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.070516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.070940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.100757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2ac933de-296d-42e5-832c-180d4650272a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 06 12:04:52.101325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1102/2253] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:52.167678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:52.169867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:52.175856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.176341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.176782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.177469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.177960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.178390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.208551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-727a0386-efd3-4e64-820e-c9f486e35d95 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Sep 06 12:04:52.209115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1152/2254] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:52.385033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:52.387103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:52.392950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.393424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.393885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.394566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.395012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.395430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.425616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ef866aa-5e27-4833-be89-b9173e5c8e59 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Sep 06 12:04:52.426192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1103/2255] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:52.568564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:52.570798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:52.576773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:52.577584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.578112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.578551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.578904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:52.579247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.579703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.580128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.585095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.585578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.586035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.586727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:52.587698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:52.588101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:52.611869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e42ed5ee-3d28-438b-99e0-c37f39a1af3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047224 Sep 06 12:04:52.612449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1153/2256] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:52.617979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae217f4c-1581-4ab4-9fe2-ba6cef8720f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Sep 06 12:04:52.619034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1104/2257] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:53.114662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:53.116808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:53.123400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.123875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.124309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.124989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.125436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.125877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.156352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8b5f2d25-abfe-48aa-acf2-a4854ab108d1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Sep 06 12:04:53.156923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1154/2258] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:53.221007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:53.223217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:53.230451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.230937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.231372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.232082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.232516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.232940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.263431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35803a53-2dbb-443e-9e36-a732711b3795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Sep 06 12:04:53.263896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1105/2259] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:53.437980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:53.440183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:53.446288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.446870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.447271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.447971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.448413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.448832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.452538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:53.478875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa95a513-51d7-445e-9e61-f9b2c26ddf2e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Sep 06 12:04:53.479438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1155/2260] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:53.624557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:53.626782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:53.630083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:53.632239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:53.633327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.633867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.634812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.635509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.635955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.636375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.640390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.640885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.641323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.642054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:53.643229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:53.643655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:53.668494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-668450da-f775-4870-98a8-806f5e76e1fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047869 Sep 06 12:04:53.669384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1106/2261] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:53.679124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fcd0f156-f5ef-41a1-ae73-8f4cfb757c2a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052983 Sep 06 12:04:53.679686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1156/2262] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:54.168563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:54.170802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:54.176777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.177262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.177726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.178420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.178963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.179305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.209445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e9a5eb32-cc0b-4566-8224-0aac22c40bbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Sep 06 12:04:54.210044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1107/2263] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:54.276525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:54.278817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:54.284980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.285456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.285929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.286626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.287094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.287519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.317848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1f9b4a2-4441-4123-a81c-e735c94760e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Sep 06 12:04:54.318433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1157/2264] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:54.491596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:54.494578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:54.500603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.501089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.501526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.502250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.502705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.503127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.532856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8b621e4c-6ae2-4dac-bcf5-ae43119bdfbe tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Sep 06 12:04:54.533418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1108/2265] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:54.681634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:54.683805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:54.690682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.691166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.691600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.692288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.692552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:54.693035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.693193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.694703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:54.701520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.702039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.702477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.703204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:54.703651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:54.704073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:54.725069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-093b513a-3f20-4a8b-b194-c573d54b7fed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047545 Sep 06 12:04:54.725636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1158/2266] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:54.736644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-42f73ad2-de4f-4df7-b37f-b526f9b9ca6f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047905 Sep 06 12:04:54.737200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1109/2267] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:55.222276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:55.224465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:55.230712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.231197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.231632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.232313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.232771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.233197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.264357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed9d2451-859f-4ef7-b553-a33ab2e618a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Sep 06 12:04:55.264946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1159/2268] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:55.330808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:55.332996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:55.339741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.340230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.340673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.341369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.341851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.342285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.371705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f470875-e6c1-477c-8876-05f37513e045 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Sep 06 12:04:55.372267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1110/2269] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:55.545803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:55.547861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:55.553782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.554264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.554695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.555372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.555821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.556950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.585885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89bdf84b-e669-4569-ac3c-06d6d96df764 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Sep 06 12:04:55.586434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1160/2270] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:55.738164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:55.740411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:55.747377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.747866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.748296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.748985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.749131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:55.749578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.750131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.751450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:55.758160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.758650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.759671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.760380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:55.760861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:55.761269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:55.783642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-304c5da9-ebf0-42ad-bd76-332720f650dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049449 Sep 06 12:04:55.784233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1111/2271] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:55.792074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a330000d-5a7d-4068-bd66-31af7581b7a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Sep 06 12:04:55.792682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1161/2272] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:56.277720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:56.280003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:56.286163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.286652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.287094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.287812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.288261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.288687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.320717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-595a6d57-22ef-4048-bc38-2bb489a27337 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047531 Sep 06 12:04:56.321339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1112/2273] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:56.384416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:56.386648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:56.392601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.393087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.393527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.394239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.394694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.395116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.425709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3db9cc47-9114-484c-8c3a-85f0536c30b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Sep 06 12:04:56.426264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1162/2274] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:56.598259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:56.600483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:56.607244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.607725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.608163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.608851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.609297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.609753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.639609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-38366a04-0c1e-477d-85b0-23654a466d46 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Sep 06 12:04:56.640181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1113/2275] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:56.797188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:56.799438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:56.804832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:56.805511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.806147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.806647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.807085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:56.807287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.807748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.808180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.813637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.814160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.814602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.815295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:56.815776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:56.816207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:56.839415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-793836e2-5c30-4fc8-8c2a-f92fff9d5124 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046462 Sep 06 12:04:56.840053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1163/2276] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:56.847894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-879efb57-caef-40cf-9ac7-5a58ab8f839d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Sep 06 12:04:56.848447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1114/2277] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:57.335375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:57.337605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:57.344097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.344589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.345032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.345760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.346219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.346648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.378606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fd8278e6-894d-4228-a803-55849de87405 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 Sep 06 12:04:57.379199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1164/2278] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:57.438452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:57.440632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:57.446884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.447381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.447823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.448532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.448991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.449419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.475996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:57.484995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7888789-8a02-49dc-8653-7f7f73ea60a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050496 Sep 06 12:04:57.485587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1115/2279] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:57.653220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:57.655357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:57.661399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.661928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.662370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.663062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.663522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.663978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.693235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efe74fb5-21e9-4984-bd03-bdecee819229 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Sep 06 12:04:57.693820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1165/2280] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:57.852269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:57.855474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:57.860155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:57.862189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.862462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:57.862675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.863111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.863808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.864260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.864730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.868675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.869174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.869617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.870346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:57.870807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:57.871236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:57.896398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1127d62e-0f8b-425c-b292-f0b8d1c23b19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048135 Sep 06 12:04:57.897537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1116/2281] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:57.903374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-60eea19f-9502-4261-a0fe-78122328c9f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047121 Sep 06 12:04:57.903879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1166/2282] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:58.391416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:58.393597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:58.400536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.401029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.401485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.402211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.402658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.403081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.432569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d4bb507b-801f-48dc-b592-10c3e3206b9d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Sep 06 12:04:58.433129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1117/2283] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:58.498006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:58.500191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:58.502155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:58.507522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.508010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.508452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.509930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.510377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.510790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.540965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-00238db5-d8e5-4e03-ac6a-48ac9d7b01fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047303 Sep 06 12:04:58.541625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1167/2284] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:58.705796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:58.707990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:58.714676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.715150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.715581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.716270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.716719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.717140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.746888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc21e861-c53c-4b41-a397-67b0728fdb27 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Sep 06 12:04:58.747447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1118/2285] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:58.910333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:58.912520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:58.916342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:58.918565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:58.919873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.920363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.920806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.921508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.922017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.922446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.924588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.925064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.925490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.926195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:58.926646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:58.927064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:58.952764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a115d256-5181-46e6-af95-36215b41b9fb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046369 Sep 06 12:04:58.953347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1168/2286] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:04:58.957206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b18de99-6d34-4635-ad3f-14c0cc9b1c43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Sep 06 12:04:58.957783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1119/2287] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:04:59.444533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:59.447308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:59.453254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.453763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.454226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.454907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.455353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.455769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.484104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-28acc868-607f-4cf9-b920-de0d18bbb096 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Sep 06 12:04:59.484654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1169/2288] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:59.553581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:59.555733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:59.562350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.562835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.563274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.563969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.564427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.564849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.594403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bf7a6762-438c-4c54-b89b-97e93e1b6e45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Sep 06 12:04:59.594962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1120/2289] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:59.759687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:59.761531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:59.767648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.768143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.768608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.769332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.769829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.770257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.801908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-00602980-b962-44bf-9713-dcf241c3e11f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Sep 06 12:04:59.802501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1170/2290] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:04:59.966390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:59.968536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:59.969946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:04:59.972085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:04:59.975015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.975522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.975950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.976648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.977100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.977523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.979316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.979804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.980243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:04:59.980934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:04:59.981394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:04:59.981977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.007314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:00.007535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f4436699-8c9e-447e-be57-17de6e7e6b7a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045864 Sep 06 12:05:00.008098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1121/2291] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:04:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:00.012826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae964a63-0857-48b8-a5c5-20a3e1b7a1ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046835 Sep 06 12:05:00.013398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1171/2292] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:04:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:00.496644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:00.498959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:00.505054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:00.505470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:00.505956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.506649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:00.507102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:00.507536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.538796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9a7595b-11cd-4158-af3e-cf2d9e4c07b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Sep 06 12:05:00.539394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1122/2293] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:00.607447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:00.609655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:00.616655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:00.617147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:00.617587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.618322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:00.618781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:00.619236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.653258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b357f92d-37ed-469a-9a39-0897f4cf4fd6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 Sep 06 12:05:00.653880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1172/2294] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:00.815858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:00.818287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:00.837766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:00.837766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:00.837766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.837766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:00.839378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:00.839378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:00.861502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4681e1d9-3dc5-49e1-8727-48bed2bc7857 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049795 Sep 06 12:05:00.862039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1123/2295] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:01.020894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:01.023399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:01.024626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:01.027472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:01.031406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.031910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.032369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.033202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.033730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.034393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.034536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.034998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.035439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.036148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.036607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.037077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.070268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5cf227a6-10c8-4a52-8a0a-36a992d5afbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049589 Sep 06 12:05:01.070756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1124/2296] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:01.071303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-794f0889-ef9f-463b-9707-944f7115ab0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054553 Sep 06 12:05:01.071884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1173/2297] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:01.551661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:01.553856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:01.560528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.561013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.561454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.562174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.562629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.563054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.592357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e15ed110-a19f-498a-a4a6-eeb40c74aa9e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Sep 06 12:05:01.592918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1125/2298] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:01.667058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:01.669307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:01.675286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.675762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.676196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.676904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.677352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.677810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.706373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c76b5a3-03d3-4f2a-b2bc-8e949b4ab99c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Sep 06 12:05:01.706928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1174/2299] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:01.874139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:01.876237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:01.882284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.882769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.883208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.883895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:01.884353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:01.885276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:01.915097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-97439322-cb3a-49a4-9e05-b6ab823098ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Sep 06 12:05:01.915658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1126/2300] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:02.083187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:02.083808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:02.085913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:02.086326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:02.089164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:02.094360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.094855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.095327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.095633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.096036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.096145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.096495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.096610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.096925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.097243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.097782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.098208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.129010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a2aaed8-2f9b-46d7-87a4-35db97f9603f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048990 Sep 06 12:05:02.129237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c7b4924-7566-4075-92ee-43e88fe64a7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049664 Sep 06 12:05:02.129900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1175/2302] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:02.130029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1127/2302] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:02.605511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:02.607781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:02.613931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.614414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.614851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.615538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.615995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.616423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.651069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d4ffbb8-77d9-452a-bac3-bbbf2abacfee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049918 Sep 06 12:05:02.651372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1128/2303] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:02.719148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:02.721437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:02.727594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.728079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.729027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.729805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.730280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.730705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.760496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d2ab6d08-1b15-4540-bc2e-4e530b33cc15 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Sep 06 12:05:02.761062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1176/2304] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:02.927430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:02.929575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:02.935830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.936317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.936758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.937446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:02.937931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:02.938361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:02.967613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9cb37114-c02f-46f9-bd19-5b2d19b1f7e5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Sep 06 12:05:02.968186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1129/2305] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:03.141696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:03.142372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:03.143932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:03.144056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:03.151220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.151413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.151699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.151829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.152136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.152257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.152828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.152979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.153295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.153428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.153745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.153860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.184482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8e14a731-471d-4bc6-aba5-2eac088f3bfd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Sep 06 12:05:03.184714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aff10fa5-6c29-4130-9916-b9f9c14998f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046616 Sep 06 12:05:03.185006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1177/2307] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:03.185125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1130/2307] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:03.663323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:03.665486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:03.671850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.672328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.672761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.673435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.673914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.674335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.704559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9708425b-681c-497d-8faa-e161faa8260b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Sep 06 12:05:03.705356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1178/2308] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:03.773451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:03.775724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:03.781911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.782400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.783289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.784359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.784824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.785259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.817103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c18d297-17a3-406d-a0b5-f749d091c4ac tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045704 Sep 06 12:05:03.817103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1131/2309] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:03.980922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:03.982849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:03.988968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.989770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.989922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:03.990618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:03.991079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:03.991504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.021429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c4fa21f-a614-4bbb-939d-3c246c77b35a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Sep 06 12:05:04.022277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1179/2310] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:04.196183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:04.196735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:04.198942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:04.199103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:04.205425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.205625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.205953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.206064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.206392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.206527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.207106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.207224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.207539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.207665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.207958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.208067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.227028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:04.239053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3dbd2578-5450-4d5b-97fb-01f46071e270 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046178 Sep 06 12:05:04.239557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1180/2311] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:04.241049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2142fac9-6632-43d4-922f-1fba1dbd4428 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048820 Sep 06 12:05:04.241618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1132/2312] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:04.719526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:04.722190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:04.729774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.730285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.730735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.732422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.732422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.732651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.766863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e482b2fd-876c-4b9a-a0e5-7bf5d66ef8fb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052108 Sep 06 12:05:04.767456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1181/2313] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:04.829051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:04.831398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:04.837872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.838921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.839361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.840072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:04.840536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:04.840968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:04.873346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-230b9a9f-1650-4702-bb7f-5d70e80c29ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Sep 06 12:05:04.873974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1133/2314] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:05.034502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:05.036701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:05.043807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.044302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.044746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.045557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.046119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.046550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.079289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f42a60e0-707b-4e9f-9716-0182968fddd0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048815 Sep 06 12:05:05.079851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1182/2315] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:05.252410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:05.254379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:05.254930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:05.256624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:05.263048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.263553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.263748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.264047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.264234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.264580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.264767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.265196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.265362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.265624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.265872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.266172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.297691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0ba60190-413d-4347-9d3a-8a1912c2ba74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Sep 06 12:05:05.298358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1183/2316] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:05.306098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f7ff5dc-9874-462f-a9ac-508da67531f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058265 Sep 06 12:05:05.307207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1134/2317] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:05.782074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:05.785861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:05.796744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.797634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.798516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.799798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.800661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.801445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.837601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-337fb234-07d6-416a-aea0-ae3b68a1666e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061857 Sep 06 12:05:05.838856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1184/2318] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:05.886853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:05.889111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:05.895443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.895920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.896350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.897286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:05.897759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:05.898177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:05.928286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aed33c4c-6044-4646-98ea-128f4373c4f1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Sep 06 12:05:05.928860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1135/2319] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:06.092570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:06.094665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:06.100539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.101014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.101445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.102144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.102596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.103012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.133530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f4a350b-0536-4c51-8425-197f8e99d189 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Sep 06 12:05:06.134120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1185/2320] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:06.311541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:06.313754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:06.319366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:06.320342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.320836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.321278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.321848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:06.321983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.322494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.323054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.328720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.329200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.329629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.330350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.330797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.331220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.355528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7970e059-b875-4e25-b5bc-a9d0c379eaf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048858 Sep 06 12:05:06.356034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1136/2321] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:06.362509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1d6ebce1-af43-4236-9208-bce5eea91966 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047072 Sep 06 12:05:06.363069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1186/2322] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:06.852578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:06.855559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:06.861481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.861998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.862433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.863108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.863556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.863971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.893691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ffe9d885-2991-46bb-88f8-58aea131557f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Sep 06 12:05:06.894267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1137/2323] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:06.944406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:06.948318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:06.958830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.959931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.960696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.961966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:06.963276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:06.964041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:06.998647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9264dce-98fc-4619-9196-c18266e1c40a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061618 Sep 06 12:05:06.999224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1187/2324] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:07.147416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:07.149580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:07.156450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.156939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.157382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.158132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.158588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.159016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.190271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c938eb1b-8445-4652-a122-9ef291a9406c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047156 Sep 06 12:05:07.190862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1138/2325] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:07.368250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:07.370726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:07.375140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:07.377349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.377480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:07.377877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.378321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.379031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.379489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.379911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.384152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.384641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.385765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.386276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.387141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.387141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.400293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:07.414824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f04ddc5-cced-47fd-80b9-19eed05f1d6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050513 Sep 06 12:05:07.415412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1188/2326] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:07.418828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-89c1415b-8a0a-46b2-b9f5-bd9f163d2df7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047562 Sep 06 12:05:07.419326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1139/2327] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:07.906395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:07.908582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:07.914570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.915060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.915499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:07.916239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:07.916792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:07.917316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.011928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:08.014147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:08.020518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f31cf064-5c03-4b29-af6d-fb3a6402a4fe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/action" status: 200 len: 41699 microversion: 2.1 time: 0.117810 Sep 06 12:05:08.020724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.021075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.021233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1189/2328] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 12:05:07 2022] POST /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839/action => generated 41699 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:08.021516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.022602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.023065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.023491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.056582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ea054c2-77c7-4cea-826a-3b47159f0065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049166 Sep 06 12:05:08.057192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1140/2329] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:08.205044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:08.207326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:08.214669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.215155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.215594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.216286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.216745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.217177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.247823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7dbe3c1f-2c34-43c0-ab72-21582cc0abb9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 Sep 06 12:05:08.248388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1190/2330] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:08.428409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:08.430617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:08.431224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:08.434035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:08.437683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.438169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.438601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.439318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.439764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.440178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.440364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.440858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.441304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.442040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:08.442504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:08.442934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:08.472046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e29bd447-c2ce-4ee3-a09a-5f3b99bcca51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047462 Sep 06 12:05:08.472535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1141/2331] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:08.474931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a2f3b32-a63e-4856-8b3d-b55e6373d137 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047636 Sep 06 12:05:08.475632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1191/2332] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:09.069517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:09.071732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:09.078118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.078605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.079045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.079745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.080201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.080628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.114724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7746aab9-85c5-404a-a26c-bddf3735837f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049124 Sep 06 12:05:09.115646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1142/2333] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:09.261113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:09.263307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:09.270108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.270590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.271022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.271712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.272417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.272844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.304752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-93e09832-87e2-4de5-b45a-ef6fd0f3b954 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Sep 06 12:05:09.305347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1192/2334] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:09.484952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:09.487157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:09.489904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:09.492099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:09.493575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.494088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.494524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.495206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.495659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.496082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.498778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.499320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.499784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.500839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:09.500967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:09.501390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:09.528816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4aa6045-dfb1-4af4-b72d-bda89591183a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048069 Sep 06 12:05:09.529633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1143/2335] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:09.535674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b85491b-0dd2-49b8-89e9-27df1b941f45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051360 Sep 06 12:05:09.536247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1193/2336] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:10.127438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:10.129699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:10.137210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.137728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.138174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.138891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.139355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.139785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.174851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-75e315d7-cb8c-4b97-82b6-3b77f3e0b810 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051364 Sep 06 12:05:10.175447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1144/2337] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:10.318115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:10.320267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:10.326823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.327319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.327852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.328666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.329183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.329700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.361140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f79ad6b-30be-4906-a5b3-7c9981429c3d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047018 Sep 06 12:05:10.361717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1194/2338] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:10.540822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:10.543842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:10.549924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:10.550710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.550710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.551115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.551813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.552273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.552750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.553041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:10.561005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.561489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.561960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.562664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:10.563110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:10.563615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:10.585951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dd43cb08-faaf-44cb-a316-6a3c18ffbd5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049273 Sep 06 12:05:10.586536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1145/2339] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:10.596839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c6f4cc2-c6d8-4fd1-8366-9e3891749b8f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051728 Sep 06 12:05:10.597409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1195/2340] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:11.188388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:11.190572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:11.198272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.198766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.199203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.199906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.200353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.200799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.231696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5e9bcdf5-9ebe-4310-8a1f-9a330867e21a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 Sep 06 12:05:11.232282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1146/2341] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:11.373716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:11.376070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:11.382767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.383250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.383689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.384387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.385543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.386047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.417070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b7e5d18e-d346-4130-99bb-55784fc6f70c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Sep 06 12:05:11.417659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1196/2342] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:11.600024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:11.602326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:11.609474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.610010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.610445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.611144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.611596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.612013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.612205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:11.614428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:11.621180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.621734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.622122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.622825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:11.623273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:11.623697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:11.655372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f1451463-591a-4d46-9c6a-deb4d27c158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059073 Sep 06 12:05:11.655976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1147/2343] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:11.663623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c897da7f-7b7b-458b-bdda-a1abd6814775 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056563 Sep 06 12:05:11.664423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1197/2344] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:12.244708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:12.246905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:12.253897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.254375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.254807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.255498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.255945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.256364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.291422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b4bf3b4-0d87-4679-aed9-3622f79190de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050041 Sep 06 12:05:12.291886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1148/2345] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:12.429917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:12.432953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:12.439803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.440299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.440742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.441456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.441943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.442372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.474277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0a3bf138-1bc7-486e-acee-4110156842ad tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Sep 06 12:05:12.474844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1198/2346] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:12.669413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:12.671606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:12.677730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.678224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.678669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.679146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:12.679602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.679801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.680226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.681437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:12.684857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:12.689582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.690420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.691166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.692445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:12.693261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:12.694059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:12.713767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bcfc6e9c-c294-49eb-b048-ca09e4fb98d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048666 Sep 06 12:05:12.714757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1149/2347] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:12.726749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-35edcf2f-e98f-40db-bc3a-a2153e851414 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051575 Sep 06 12:05:12.727306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1199/2348] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:13.304655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:13.307008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:13.313925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.314415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.314861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.315566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.316025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.316453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.353972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e270bb2-974a-4728-8fa4-bcbf212a2c83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053119 Sep 06 12:05:13.354710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1150/2349] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:13.487705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:13.489934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:13.497114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.497660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.498261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.499023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.499594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.500078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.535181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0c01d4c0-c5b2-4281-8b1b-4e40f112c376 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051483 Sep 06 12:05:13.535850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1200/2350] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:13.726592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:13.730219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:13.736720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.737095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.737751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.738456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.738918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.739346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.739943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:13.742560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:13.749457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.750051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.750488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.751189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:13.751638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:13.752140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:13.777869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-da8bbae7-7268-4ae3-8804-381dfa74657f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055510 Sep 06 12:05:13.778810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1151/2351] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:13.787741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6bf06240-abe2-4b6b-98b2-795ad2b7822e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051775 Sep 06 12:05:13.788332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1201/2352] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 6 12:05:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:05:14.367805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:14.370492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:14.377519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.378053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.378500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.379222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.379680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.380112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.413407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8500f2fd-7d24-49a4-aed0-463808afb226 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049456 Sep 06 12:05:14.414279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1152/2353] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:14.548243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:14.550472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:14.557840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.558331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.558767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.559464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.559909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.560329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.590989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee1fbfce-2712-4752-bbc8-4a4efc077750 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046658 Sep 06 12:05:14.591572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1202/2354] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:14.790750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:14.793525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:14.800655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.801146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.801383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:14.802007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.802287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.802769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.803191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.803662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:14.810720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.811197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.811642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.812315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:14.812770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:14.813189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:14.856070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a684648d-2f31-4cfe-9d4d-2d564291ad38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068954 Sep 06 12:05:14.857152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1153/2355] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:14.911290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f461071-bb46-42ca-b9b0-ce0299e82509 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action" status: 200 len: 37675 microversion: 2.20 time: 0.114122 Sep 06 12:05:14.911950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1203/2356] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 6 12:05:14 2022] POST /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54/action => generated 37675 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:05:15.426294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:15.428449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:15.436015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:15.436510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:15.436950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:15.437671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:15.438134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:15.438558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:15.472331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d24a9f96-652b-493c-aa4c-ad760c543cb9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049915 Sep 06 12:05:15.472953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1154/2357] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:15.604633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:15.607004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:15.614370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:15.614868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:15.615310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:15.616015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:15.616468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:15.616899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:15.667841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe59cbc6-bca1-4cf2-b33c-312fe858593e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067712 Sep 06 12:05:15.668456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1204/2358] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:15.871578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:15.873993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:15.880598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:15.881164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:15.881611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:15.882395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:15.882853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:15.883286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:15.921263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-910389d5-d1c5-43c8-8c06-864bd7b64b58 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054465 Sep 06 12:05:15.921894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1155/2359] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:16.485759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:16.488403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:16.496943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.497598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.498131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.498905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.499418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.499892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.533325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:16.538807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29aefdcd-e192-47f3-b2bd-9656c75f7c76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057662 Sep 06 12:05:16.539406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1205/2360] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:16.681125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:05:16.684011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:16.690868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.691360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.691799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.692541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.692996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.693428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.798668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8053e77b-52d0-42bf-b6fa-50e53a361886 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action" status: 200 len: 82219 microversion: 2.1 time: 0.121177 Sep 06 12:05:16.799317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1156/2361] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 12:05:16 2022] POST /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/action => generated 82219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:05:16.819096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:16.819987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:16.831183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.831675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.832107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.832805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.833300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.833766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.920183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lazy-loading 'services' on Instance uuid 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:05:16.935373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:16.937862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:16.945401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.946005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.946840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.947211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:16.948173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:16.948611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:16.981810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5f8f966d-a913-4818-b258-bed9a688cdc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052128 Sep 06 12:05:16.982576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1157/2362] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:16.984986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Request method failure captured: Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments/23a53333-4387-4373-b5a6-ea18b241b05f HTTP/1.1 Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzR7qZYZsL4rG-JBBxui76bOcAYzCDpbhEh3-KpQKotmuTQV8k_PBgg8joEDhsr_El8jF_wIzaXpK4nbALI0rKnpFL3YFVFin3gx8o34jp5HUnYzb89t2NZjSe80mQ6zH0pNLCki7ypcmZMo6I09cFVi41tadj9LUK4WxvE4b3WOWx8 Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 474249b02d3140b6bae6ec312cdd142f Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-TestMinimumBasicScenario-1735965693 Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:05:16.992711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/474249b02d3140b6bae6ec312cdd142f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/474249b02d3140b6bae6ec312cdd142f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_474249b02d3140b6bae6ec312cdd142f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/474249b02d3140b6bae6ec312cdd142f"}]}] Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-TestMinimumBasicScenario-1735965693 Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 474249b02d3140b6bae6ec312cdd142f Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1735965693 Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-TestMinimumBasicScenario-1735965693-project Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 683b8a5c6d9048fe871fc563c9e45ca9 Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-TestMinimumBasicScenario-1735965693-project Sep 06 12:05:16.995808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'server_id': '3c25daad-79a8-415a-bfb0-7678bbfe0ef2', 'id': '23a53333-4387-4373-b5a6-ea18b241b05f'} Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 06 12:05:16.996650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:05:16.999091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:17.001346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:05:17.003003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) Sep 06 12:05:17.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:05:17.006024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73868393-82c8-4979-956f-1b4ec3ec401a) {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:05:17.006024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f1d7e25-ce64-49f9-aca7-4936805f31e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments/23a53333-4387-4373-b5a6-ea18b241b05f" status: 400 len: 269 microversion: 2.1 time: 0.182791 Sep 06 12:05:17.006024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1206/2363] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 12:05:16 2022] DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2/os-volume_attachments/23a53333-4387-4373-b5a6-ea18b241b05f => generated 269 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:05:17.555337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:17.558083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:17.564861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:17.565339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:17.565813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:17.566500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:17.566949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:17.567369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:17.598187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c079c3a7-86fd-4868-8ae2-2c7a3b9d3959 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Sep 06 12:05:17.598759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1158/2364] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:17.995613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:17.997913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:18.005157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:18.005670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:18.006132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:18.006849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:18.007312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:18.007743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:18.040594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29244aad-7fca-4f80-a783-9cbb280342c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050043 Sep 06 12:05:18.041270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1207/2365] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:18.611195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:18.613384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:18.620210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:18.620693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:18.621128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:18.621851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:18.622305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:18.622721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:18.661156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f863205-c1b8-45b3-a5c3-d9e904401c52 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053915 Sep 06 12:05:18.661783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1159/2366] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:19.058934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:19.062967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:19.073351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:19.074096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:19.074716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:19.075862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:19.076444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:19.076929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:19.126913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1c2f458b-0c08-4977-b356-ad772e80e497 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075699 Sep 06 12:05:19.127570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1208/2367] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:19.676032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:19.678312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:19.685863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:19.686605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:19.687158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:19.688040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:19.688616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:19.689160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:19.723138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b312ad8-ea51-45bc-b6f9-f07c05fdc826 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052180 Sep 06 12:05:19.723753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1160/2368] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:20.141574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:20.143841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:20.152129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:20.152624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:20.153068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:20.153828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:20.154293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:20.154759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:20.188618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c8c734d-e9a3-4747-ae5a-c0e64315c35b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051060 Sep 06 12:05:20.189217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1209/2369] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:20.736310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:20.738671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:20.746262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:20.746758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:20.747209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:20.747916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:20.748376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:20.748803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:20.782964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9522e818-5f7d-469c-89db-ac4e19986f7d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050747 Sep 06 12:05:20.783543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1161/2370] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:21.206075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:21.209914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:21.222482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:21.223323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:21.224096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:21.225367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:21.226031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:21.226791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:21.278975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e5b26455-e878-4247-8c8c-72555bde1003 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080425 Sep 06 12:05:21.279599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1210/2371] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:21.796051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:21.798267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:21.805521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:21.806037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:21.806978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:21.807743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:21.808200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:21.808629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:21.843442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00d74fa0-d204-43cd-a6e1-0eb83668e797 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051543 Sep 06 12:05:21.844033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1162/2372] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:22.292218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:22.294503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:22.301338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:22.301888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:22.302336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:22.303050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:22.303509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:22.303938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:22.336864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4c27801b-b96e-4930-b381-ef19bf119a46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048770 Sep 06 12:05:22.337490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1211/2373] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:22.856970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:22.859219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:22.866284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:22.866778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:22.867222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:22.867943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:22.868401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:22.868836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:22.907008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-852efcca-2d72-4f01-a229-a91e017ba68b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055210 Sep 06 12:05:22.907495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1163/2374] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:23.353462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:23.356809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:23.364065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:23.364617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:23.365096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:23.365907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:23.366407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:23.366910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:23.403194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6ea86037-c335-4858-bb59-97337a8729ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054338 Sep 06 12:05:23.403790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1212/2375] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:23.920655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:23.924293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:23.932630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:23.933182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:23.933792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:23.934770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:23.935394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:23.936075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:23.972492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62a883d1-110e-4bea-9380-77df1f601a5f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056592 Sep 06 12:05:23.973094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1164/2376] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:24.421148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:24.425822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:24.433056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:24.433548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:24.434011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:24.434723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:24.435182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:24.435612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:24.466718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-490a5559-fa25-45a3-9f8b-bbd174a8db68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051230 Sep 06 12:05:24.467293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1213/2377] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:24.986778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:24.988960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:24.991120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:05:24.991267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:05:25.001897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.002315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.002766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.003506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.003898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.004320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.036049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d708b287-0f73-40ba-b865-cb0408466c4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053219 Sep 06 12:05:25.036603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1165/2378] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:25.479570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:25.481735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:25.488233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.488716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.489179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.489870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:25.490328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:25.490750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:25.523915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5c50a614-151a-425d-aa9b-e2bfefd1c83a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Sep 06 12:05:25.524475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1214/2379] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:26.049104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:26.051366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:26.059403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:26.059893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:26.060337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:26.061047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:26.061513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:26.061986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:26.066175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:26.094733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66c2f074-c063-4c9e-aa7b-9d5e8e7e4202 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050026 Sep 06 12:05:26.095335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1166/2380] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:26.536849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:26.538977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:26.546099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:26.546589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:26.547030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:26.547722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:26.548176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:26.548598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:26.579297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f1008aa6-cdd9-4460-9cd5-79f7ce1f0b37 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Sep 06 12:05:26.579856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1215/2381] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:27.107386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:27.109536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:27.116236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:27.116733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:27.117178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:27.117957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:27.118369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:27.119452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:27.149956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-578b2048-5505-45df-a1a6-4435c457ccc0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 Sep 06 12:05:27.151095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1167/2382] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:27.592009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:27.594234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:27.600711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:27.601199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:27.601656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:27.602351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:27.602810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:27.603771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:27.633704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6f87d8c4-57bc-4cd9-8ad8-27e74270df74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045750 Sep 06 12:05:27.634271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1216/2383] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:28.162322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:28.164474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:28.171696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:28.172192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:28.172640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:28.173350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:28.173849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:28.174285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:28.205247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b87cc7c9-505b-4488-bee5-8ccb687ef286 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046858 Sep 06 12:05:28.205754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1168/2384] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:28.646375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:28.648744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:28.651937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:28.657347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:28.658023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:28.658464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:28.659163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:28.659625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:28.660056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:28.699146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7045504b-b00c-4de2-a578-65472bc85750 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056318 Sep 06 12:05:28.700211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1217/2385] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:29.217413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:29.219606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:29.226428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.226933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.227376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.228138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.228628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.229058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.263164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc93cac5-f809-4333-af34-ee20aab5ca89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049905 Sep 06 12:05:29.263828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1169/2386] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:29.712173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:29.714570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:29.721003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.721495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.721972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.722670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:29.723129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:29.723565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:29.754540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-942ecd51-aac2-41b1-bd23-4d040361bdc7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046321 Sep 06 12:05:29.755113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1218/2387] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:30.277225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:30.280430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:30.286834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:30.287319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:30.287753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:30.288438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:30.288896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:30.289316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:30.320905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a4fbfa4-edfc-415a-8c6a-1e69068c4557 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048059 Sep 06 12:05:30.321476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1170/2388] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:30.767482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:30.769575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:30.776767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:30.777275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:30.777739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:30.778437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:30.778928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:30.779316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:30.814858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1d0f1b6-b16f-4b71-b6b6-7353028b95e8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051701 Sep 06 12:05:30.815588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1219/2389] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:31.334409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:31.336573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:31.343040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:31.343533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:31.344003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:31.344692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:31.345146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:31.345573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:31.375816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dd78f6e0-022a-4dd3-a6e2-f545345b07bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Sep 06 12:05:31.376301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1171/2390] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:31.829156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:31.831364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:31.838951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:31.839439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:31.839880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:31.840572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:31.841028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:31.841458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:31.870624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-67640180-7a68-4e49-a794-c2945f288c7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Sep 06 12:05:31.871177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1220/2391] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:32.389061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:32.391388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:32.393803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=90 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:32.399320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.399802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.400734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.401435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.401923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.402350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.432716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1673d7b5-1152-43ff-ad90-f41828dda56f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Sep 06 12:05:32.433192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1172/2392] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:32.883189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:32.886013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:32.893368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.893908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.894357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.895066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:32.895531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:32.895961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:32.927775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1781c4f6-4f6f-4ce0-9fa6-8a33ee1b4cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048612 Sep 06 12:05:32.928340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1221/2393] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:33.445167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:33.447991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:33.454424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:33.454912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:33.455355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:33.456082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:33.456535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:33.456963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:33.486879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3f0c75c0-277c-4849-9e1a-676383884cc1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Sep 06 12:05:33.487366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1173/2394] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:33.940552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:33.942988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:33.950096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:33.950591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:33.951033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:33.951767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:33.952230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:33.952663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:33.957042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:33.987250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e53e8bca-61c5-480a-91e4-58d798c580b8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050563 Sep 06 12:05:33.987862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1222/2395] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:34.500276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:34.502518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:34.510611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:34.511321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:34.511816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:34.512576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:34.513084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:34.513562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:34.545501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-89114c20-ac30-43af-aea2-2cc53dd2b851 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049183 Sep 06 12:05:34.546122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1174/2396] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:35.000373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:35.002619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:35.009224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:35.009795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:35.010240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:35.010949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:35.011411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:35.011836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:35.042989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e39f1ca6-e257-4571-8a87-f99c457d8e6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046625 Sep 06 12:05:35.043581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1223/2397] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:35.559299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:35.561370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:35.568247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:35.568742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:35.569190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:35.569937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:35.570397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:35.570824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:35.600783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4aff497b-6cfc-40e0-aeff-1e69b31e2372 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Sep 06 12:05:35.601348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1175/2398] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:36.056113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:36.058584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:36.065299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:36.065842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:36.066283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:36.066988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:36.067448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:36.067872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:36.099382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-67da5750-e40d-4c1f-b4a2-e5cd39015c74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047178 Sep 06 12:05:36.099963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1224/2399] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:36.614190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:36.616757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:36.624010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:36.624503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:36.624949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:36.625675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:36.626134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:36.626561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:36.659940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d2c722f9-f93f-4c1b-ac1e-129af1dcf302 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049874 Sep 06 12:05:36.660525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1176/2400] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:37.113220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:37.115392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:37.122605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:37.123107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:37.123543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:37.124245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:37.124699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:37.125125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:37.156326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea9e3962-f94e-4de2-824c-60111fa696f5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047249 Sep 06 12:05:37.156895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1225/2401] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:37.673057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:37.675223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:37.681739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:37.682222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:37.682662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:37.683355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:37.683802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:37.684220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:37.715851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9406ff9c-250d-42eb-b00f-ef50d72b2f93 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Sep 06 12:05:37.716441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1177/2402] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:38.169393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:38.171617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:38.178118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:38.178609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:38.179064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:38.179755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:38.180211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:38.180654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:38.211544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a47e6f4f-f585-46ec-a45b-2c5fb216af6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046640 Sep 06 12:05:38.212122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1226/2403] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:38.728871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:38.731861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:38.738592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:38.739100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:38.739535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:38.740278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:38.740789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:38.741232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:38.771721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-29d4ddf7-f202-44f9-9a2a-80bd6a13b888 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Sep 06 12:05:38.772562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1178/2404] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:39.281531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:39.283715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:39.289585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:39.290096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:39.290568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:39.291324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:39.291779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:39.292200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:39.322162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f8c096a6-eacf-412a-ae5e-e0435330f4b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101475 Sep 06 12:05:39.322744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1227/2405] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:39.784430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:39.786598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:39.793385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:39.793898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:39.794331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:39.795008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:39.795454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:39.795873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:39.825414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0629b8a-cef9-418a-bcfe-7633abbbc43b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Sep 06 12:05:39.825990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1179/2406] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:40.334976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:40.337259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:40.344016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:40.344504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:40.344945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:40.345660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:40.346138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:40.346567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:40.378870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3400b3b0-1900-4a2e-9e77-7bbfd45735b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047844 Sep 06 12:05:40.379432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1228/2407] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:40.838209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:40.840378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:40.846897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:40.847346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:40.847787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:40.848473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:40.848930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:40.849356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:40.879984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ebaac0b-1bfa-4dbb-a629-0ea93826f4b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046199 Sep 06 12:05:40.880555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1180/2408] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:41.391012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:41.393239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:41.401044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:41.401523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:41.401994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:41.402685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:41.403144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:41.403570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:41.434194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50d39b13-c31b-4c63-9fac-d82340dee8ae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Sep 06 12:05:41.434756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1229/2409] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:41.893138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:41.895315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:41.902719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:41.903203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:41.903633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:41.904318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:41.904763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:41.905178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:41.934410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e5839253-a694-462c-b42b-71b02792cdb7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045911 Sep 06 12:05:41.934969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1181/2410] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:42.447319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:42.449633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:42.456193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:42.456680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:42.457120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:42.457846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:42.458303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:42.458767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:42.490447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9179b67b-2d62-4df5-9857-0d2c6c0dfd35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Sep 06 12:05:42.491014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1230/2411] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:42.947294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:42.949443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:42.956018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:42.956502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:42.956944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:42.957632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:42.958112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:42.958536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:42.984633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:42.989937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0a1175d7-4b85-4ae3-b90a-42b93c71f065 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047069 Sep 06 12:05:42.990505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1182/2412] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:43.504006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:43.506152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:43.513537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:43.514118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:43.514562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:43.515250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:43.515701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:43.516121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:43.546715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-726cca61-6f5d-4489-bb84-a37255b0029d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Sep 06 12:05:43.547285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1231/2413] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:44.003352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:44.005513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:44.012373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:44.012844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:44.013275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:44.013984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:44.014433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:44.014856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:44.045665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3afaa9b7-71ae-43f6-b988-e5013fcf9ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 Sep 06 12:05:44.046222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1183/2414] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:44.559024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:44.561177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:44.567644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:44.568133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:44.568573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:44.569261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:44.569749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:44.570177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:44.600550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a2b219b1-a4a0-43fb-8a8a-f196c9ac9f95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Sep 06 12:05:44.601112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1232/2415] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:45.058533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:45.060694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:45.067121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:45.067607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:45.068047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:45.068800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:45.069259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:45.069719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:45.100149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f38a72bb-c1d2-47dc-929b-9411e3faf606 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046146 Sep 06 12:05:45.100709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1184/2416] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:45.613886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:45.616019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:45.623629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:45.624113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:45.624550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:45.625236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:45.625714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:45.626145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:45.658119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e76cbc6-627b-437f-afb7-dee87c81fda9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Sep 06 12:05:45.658691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1233/2417] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:46.112505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:46.114767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:46.121459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:46.122009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:46.122452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:46.123158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:46.123615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:46.124048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:46.157379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ba2d89b-a2a3-4370-87f5-a9c4fea59344 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048834 Sep 06 12:05:46.158000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1185/2418] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:46.670921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:46.673095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:46.679550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:46.680025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:46.680455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:46.681131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:46.681578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:46.682680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:46.711771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-480a6d30-279f-4003-8203-925687d4a9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Sep 06 12:05:46.712332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1234/2419] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:47.171291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:47.173632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:47.180264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:47.180757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:47.181200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:47.182234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:47.182535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:47.183063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:47.214601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1dd604c3-5041-4192-b716-d865424556b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 Sep 06 12:05:47.215130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1186/2420] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:47.724435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:47.726572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:47.733673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:47.734169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:47.734612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:47.735306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:47.735761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:47.736185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:47.766312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c1ef43a0-4b66-4959-a282-78f74137c113 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Sep 06 12:05:47.766865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1235/2421] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:48.227408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:48.230718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:48.237471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:48.238095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:48.238548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:48.239444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:48.239698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:48.240327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:48.277219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9f559c88-07b0-44a8-82d0-6537bb1ba1c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053806 Sep 06 12:05:48.277840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1187/2422] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:48.779990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:48.782098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:48.788574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:48.789064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:48.789507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:48.790233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:48.790695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:48.791126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:48.820899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-951a20e1-7a8f-424b-bc4e-e46158318c26 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Sep 06 12:05:48.821468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1236/2423] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:49.289734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:49.292284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:49.298891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:49.299379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:49.299817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:49.300593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:49.301131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:49.301562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:49.332249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f5792169-5bce-4f72-bf4a-82de2cc03fae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Sep 06 12:05:49.332811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1188/2424] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:49.833907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:49.836015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:49.842411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:49.842894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:49.843358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:49.844042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:49.844490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:49.844910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:49.875198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4eec4459-9f89-4145-9d62-9f1245c23fec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Sep 06 12:05:49.875748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1237/2425] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:05:50.346149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:50.348270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:50.355150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:50.355645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:50.356089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:50.356803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:50.357258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:50.357712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:50.389558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-441db535-a6fd-441f-8891-6e146c687b21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Sep 06 12:05:50.390172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1189/2426] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:50.887510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:50.889557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:50.896267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:50.896749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:50.897175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:50.898136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:50.898587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:50.899003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:50.925163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:50.931011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f79652fb-9fd9-442d-8c18-5196afdcc070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048135 Sep 06 12:05:50.931601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1238/2427] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:51.403754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:51.405866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:51.411976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:51.412469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:51.412911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:51.413695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:51.414077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:51.414501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:51.446212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-38ec0fdd-938c-47b1-9e11-daa614429ba1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Sep 06 12:05:51.446785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1190/2428] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:51.944484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:51.946602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:51.954079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:51.954575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:51.955014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:51.955709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:51.956182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:51.956592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:51.986312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c511ac5d-af2c-42ce-be54-cb46ffd10bb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045916 Sep 06 12:05:51.986874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1239/2429] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:52.459006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:52.461107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:52.468267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:52.468529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:52.468970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:52.469688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:52.470151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:52.470571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:52.500474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-120fcf9d-917e-45cd-b7d6-a7e0ecdae991 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045452 Sep 06 12:05:52.501033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1191/2430] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:53.002174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:53.004200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:53.011102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:53.011310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:53.011662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:53.012389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:53.012837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:53.013256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:53.043982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd894f7a-64aa-45c1-8d6f-2ca74c4aebb4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047934 Sep 06 12:05:53.044571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1240/2431] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:53.512927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:53.515057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:53.521432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:53.521946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:53.522638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:53.523339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:53.523795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:53.524222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:53.554883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d238a1ef-bbdc-4fbd-a879-0879bb8fe66c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046592 Sep 06 12:05:53.555451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1192/2432] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:54.056673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:54.059419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:54.066040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:54.066521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:54.066955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:54.067634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:54.068083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:54.068501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:54.098607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-94753475-d2bf-4c6f-9da8-558f188ef00e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Sep 06 12:05:54.099177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1241/2433] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:54.567387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:54.569525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:54.576120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:54.576717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:54.577163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:54.577888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:54.578345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:54.578773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:54.609038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-986da9b5-a5f4-4db9-83a8-d393a65049b7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 06 12:05:54.609610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1193/2434] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:55.111238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:55.113329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:55.119856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:55.120524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:55.120972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:55.121696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:55.122164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:55.122596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:55.153391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ff78cf0-ac6e-4383-81d3-f353e18255ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046173 Sep 06 12:05:55.153999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1242/2435] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:55.621746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:55.623934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:55.630126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:55.630623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:55.631072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:55.631773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:55.632274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:55.632663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:55.664466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a20a8b2c-613b-47d4-a472-583458041ef0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047249 Sep 06 12:05:55.665519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1194/2436] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:56.165480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:56.168417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:56.174915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:56.175404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:56.175846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:56.176540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:56.176996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:56.177420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:56.206440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0254e292-1ec1-422d-85eb-0b56b8569daa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Sep 06 12:05:56.206999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1243/2437] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:56.677110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:56.679213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:56.685740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:56.686216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:56.686643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:56.687317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:56.687767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:56.688185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:56.718850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-339c248b-5667-4ee9-8eb1-2a542bde8a62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Sep 06 12:05:56.719411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1195/2438] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:57.220131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:57.222273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:57.228527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:57.229577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:57.230052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:57.230752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:57.231208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:57.231637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:57.263371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3d5f6b3a-7289-4fed-9e5b-a86520cf96ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047402 Sep 06 12:05:57.264266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1244/2439] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:57.731757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:57.733866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:57.740402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:57.740886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:57.741325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:57.742064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:57.742518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:57.742943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:57.777389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc9bdd05-8877-41ea-94e7-f0fd163c9b53 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049829 Sep 06 12:05:57.778013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1196/2440] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:58.276678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:58.278856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:58.285305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:58.285826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:58.286264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:58.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:58.287397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:58.287815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:58.318968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e39a0bdc-1717-429b-9232-28649e72cb6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Sep 06 12:05:58.319570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1245/2441] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:58.790160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:58.792258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:58.798673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:58.799164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:58.799603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:58.800293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:58.800749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:58.801175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:58.831607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5bc8ff4c-c470-4e44-b074-c22e6b3cda67 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Sep 06 12:05:58.832172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1197/2442] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:59.331790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:59.333967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:59.336264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=58 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:59.341657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:59.342162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:59.342607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:59.343595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:59.343739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:59.344163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:59.373767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8b44240d-808f-47e5-9e29-443b7cf674d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Sep 06 12:05:59.374328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1246/2443] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:05:59.843771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:05:59.846012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:05:59.852362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:59.852850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:59.853291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:59.854677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:05:59.855296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:05:59.855736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:05:59.885599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3582e323-9f0f-49af-beec-f71c5495c65e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Sep 06 12:05:59.886409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1198/2444] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:05:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:00.386418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:00.388572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:00.395088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:00.395572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:00.396010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:00.396698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:00.397157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:00.397877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:00.428177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cf5a017c-cbf7-4a30-9e25-90497293e5f3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Sep 06 12:06:00.428739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1247/2445] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:00.898573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:00.900709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:00.907278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:00.907707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:00.908148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:00.908857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:00.909324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:00.909800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:00.927549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:00.941023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc2d2f81-a639-4b4a-96a1-ab0283620a9d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Sep 06 12:06:00.941599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1199/2446] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:01.440881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:01.443003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:01.450128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.450614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.451052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.451740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.452198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.452624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.483785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1d38d90e-197f-4b93-b9d2-d7702e91fa82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Sep 06 12:06:01.484351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1248/2447] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:01.954342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:01.956461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:01.962812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.963302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.964420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.965034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:01.965480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:01.965921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:01.994677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eff42b09-ec97-4226-8907-bd82ea88651d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Sep 06 12:06:01.995188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1200/2448] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:02.496493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:02.498696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:02.505515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:02.505973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:02.506417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:02.507126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:02.507584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:02.508068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:02.542567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea63ffd4-f54c-48c0-bbae-f3bb175cd968 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049642 Sep 06 12:06:02.542838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1249/2449] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:03.006235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:03.008367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:03.011361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=58 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:03.016559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:03.017041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:03.017480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:03.018194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:03.018648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:03.019069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:03.048669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-35682d15-3929-4d8f-b0a8-0dcd83a5eee9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Sep 06 12:06:03.049145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1201/2450] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:03.554844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:03.557110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:03.564405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:03.564994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:03.565438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:03.566184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:03.566631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:03.567050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:03.598882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-757649cf-f455-4c6e-94e4-ea8a6fee9c51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Sep 06 12:06:03.599522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1250/2451] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:04.060644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:04.062843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:04.070182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:04.070689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:04.071140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:04.071862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:04.072354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:04.072791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:04.107118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e140dbd-1b90-4dc4-b12b-b6027d4c763a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050289 Sep 06 12:06:04.107617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1202/2452] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:04.612684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:04.614842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:04.622628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:04.623119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:04.623561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:04.624263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:04.624722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:04.625151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:04.657504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bed98f7e-bd35-469e-92b1-7399979c2eca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Sep 06 12:06:04.658115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1251/2453] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:05.119642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:05.121870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:05.128344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:05.128828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:05.129265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:05.129987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:05.130445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:05.130871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:05.160759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac5be587-b5f0-4f4d-9772-fde7c1f85d62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Sep 06 12:06:05.161320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1203/2454] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:05.670718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:05.672925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:05.679897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:05.680334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:05.680759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:05.681468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:05.681973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:05.682412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:05.715578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-46f8b47f-32fe-49bf-a278-c0fd850786c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049286 Sep 06 12:06:05.716142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1252/2455] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:06.173240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:06.175429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:06.181957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:06.183242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:06.183763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.184385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:06.184845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:06.185269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.215540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c869cba8-8852-4d88-8b29-883ac0aecc3e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Sep 06 12:06:06.216026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1204/2456] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:06.728200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:06.731692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:06.738185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:06.738667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:06.739101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.739784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:06.740237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:06.740655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:06.771283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e0d5cb36-4b58-43a6-8fad-1f4fa95388a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046991 Sep 06 12:06:06.771848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1253/2457] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:07.227832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:07.230211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:07.236833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:07.237327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:07.237803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:07.238519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:07.238979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:07.239409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:07.271019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-748eabd0-878a-4602-b38c-500cc1481641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Sep 06 12:06:07.271515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1205/2458] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:07.784684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:07.786886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:07.793407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:07.793869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:07.794311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:07.794998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:07.795458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:07.795884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:07.826162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-01988409-352d-495c-9a47-c65cf76d3458 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 06 12:06:07.826732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1254/2459] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:08.284294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:08.286354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:08.293344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.293867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.294313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.295037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.295496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.295926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.330459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-76c3253c-3f7e-4df1-a1b4-dbfdaee25611 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 Sep 06 12:06:08.331125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1206/2460] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:08.839445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:08.841732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:08.848721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.849212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.849673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.850413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:08.850868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:08.851295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:08.871057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:08.883999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-17f88fe0-9b38-4a67-b7f5-411cbf1a0f01 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049091 Sep 06 12:06:08.884571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1255/2461] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:09.345362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:09.347657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:09.353870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:09.354848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:09.355291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:09.355993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:09.356452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:09.356879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:09.389037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12d6b3b7-7fe4-471b-b8fe-1953bae6f5ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Sep 06 12:06:09.389624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1207/2462] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:09.898147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:09.900726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:09.908302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:09.908698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:09.909245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:09.910134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:09.910604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:09.911034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:09.944125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b5170827-17ae-406c-8c97-518fb39e9e5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050370 Sep 06 12:06:09.944687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1256/2463] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:10.401144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:10.403482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:10.409983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.410481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.410934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:10.411639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.412100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.412532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:10.442812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cb10b0d2-0fa5-4f34-8549-533455f84d70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Sep 06 12:06:10.443382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1208/2464] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:10.957413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:10.959609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:10.966924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.967420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.967858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:10.968560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:10.969014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:10.969436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:11.002874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8bdd177e-ad31-4038-bbd8-6fac979c8cfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049271 Sep 06 12:06:11.003385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1257/2465] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:11.455853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:11.458109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:11.465396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:11.465941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:11.466389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:11.467199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:11.467665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:11.468096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:11.503949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-90b1d6a9-299e-44f7-b1fb-42151055ffe3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051974 Sep 06 12:06:11.504531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1209/2466] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:12.015367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:12.018485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:12.025296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:12.025824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:12.026271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:12.027533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:12.027994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:12.028422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:12.060214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7d2e1116-52f5-4db2-92f8-4f2f5e11fd78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049035 Sep 06 12:06:12.060708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1258/2467] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:12.517021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:12.519277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:12.526605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:12.527298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:12.527758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:12.528473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:12.528936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:12.529369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:12.561679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e5987c0-0160-416f-97c9-afda13083944 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Sep 06 12:06:12.562241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1210/2468] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:13.073092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:13.075802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:13.082819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:13.083316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:13.083761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:13.084468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:13.084929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:13.085360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:13.117455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-62f744c5-ee57-45b4-92f0-48443528d4db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 Sep 06 12:06:13.118120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1259/2469] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:13.574993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:13.577185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:13.583950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:13.584445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:13.584886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:13.585585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:13.586082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:13.586506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:13.629401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dbbe06cb-35c4-4d0a-b6b9-fc53148d2a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059436 Sep 06 12:06:13.630021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1211/2470] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:14.130238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:14.132400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:14.139548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:14.140029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:14.140462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:14.141140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:14.141590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:14.142037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:14.173033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfa16309-c4d2-4a19-a383-0abee23f213f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Sep 06 12:06:14.173596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1260/2471] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:14.646798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:14.650770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:14.661915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:14.662730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:14.663524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:14.664772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:14.665671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:14.666459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:14.701500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-100dab12-ddc8-4726-8209-8715acab187b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063214 Sep 06 12:06:14.702108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1212/2472] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:15.186720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:15.189197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:15.196287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:15.196785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:15.197232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:15.197977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:15.199034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:15.199461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:15.233452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d46e8b31-a976-4671-a538-637fb311561c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050988 Sep 06 12:06:15.234060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1261/2473] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:15.716173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:15.718758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:15.726462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:15.727226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:15.727825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:15.728675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:15.729145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:15.729583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:15.769621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b4b9c35f-d689-40a9-9134-f3643f3eff1d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058517 Sep 06 12:06:15.770246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1213/2474] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:16.247295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:16.249708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:16.256614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:16.257113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:16.257556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:16.258309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:16.258769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:16.259203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:16.294816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a7900321-c774-4dc6-94f1-bda00f0e517e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052135 Sep 06 12:06:16.295461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1262/2475] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:16.785951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:16.788119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:16.795330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:16.796034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:16.796485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:16.797191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:16.797671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:16.798118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:16.830726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dfc613c0-946f-4fdf-9b7b-df07769ada61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048881 Sep 06 12:06:16.831329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1214/2476] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:17.307354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:17.310069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:17.316830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:17.317312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:17.317780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:17.318470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:17.318918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:17.319337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:17.352404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4f1b7dbd-96df-432f-8c37-082a2f2cf8ab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048759 Sep 06 12:06:17.352908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1263/2477] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:17.844963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:17.847161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:17.853966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:17.854470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:17.855344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:17.855636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:17.856097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:17.856529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:17.890750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d9a6c76-d262-428b-927f-d8af5979f9cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049856 Sep 06 12:06:17.891340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1215/2478] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:18.366106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:18.368258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:18.375614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:18.376108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:18.376555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:18.377255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:18.377755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:18.378189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:18.407534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d0eee6c5-b615-4bcc-ac9c-10cb69dc00b7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Sep 06 12:06:18.408067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1264/2479] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:18.903459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:18.905626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:18.912899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:18.912899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:18.914456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:18.915168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:18.915627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:18.916053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:18.920675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:18.946494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c79c9460-d279-4aec-8568-a1aacaf22852 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047581 Sep 06 12:06:18.947260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1216/2480] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:19.420876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:19.423098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:19.429726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:19.430214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:19.430655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:19.431350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:19.431805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:19.432345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:19.462765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-681060dd-3270-4f42-ad7b-2e070b1c1f6d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Sep 06 12:06:19.463351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1265/2481] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:19.959183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:19.961358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:19.968558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:19.969039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:19.969479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:19.970206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:19.970652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:19.971066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:20.002340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ee44a0d9-25bb-4f78-888f-1081f19074b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Sep 06 12:06:20.007113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1217/2482] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:20.476115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:20.478335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:20.485616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:20.486148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:20.486593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:20.487300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:20.487761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:20.488190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:20.521258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c7ab00f8-dd6c-4946-876a-e4e2d2a17521 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048592 Sep 06 12:06:20.521258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1266/2483] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:21.015691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:21.017917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:21.024649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:21.025173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:21.025618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:21.027104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:21.027578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:21.028008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:21.060563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f2589d78-021f-44f8-917e-d4dee5961537 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049259 Sep 06 12:06:21.060979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1218/2484] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:21.533561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:21.535736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:21.542648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:21.543386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:21.543823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:21.544502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:21.544953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:21.545371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:21.575392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e8b2b86a-708d-4a8b-beac-27b0101775f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Sep 06 12:06:21.575953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1267/2485] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:22.072574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:22.075296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:22.081694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:22.082182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:22.082623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:22.083309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:22.083764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:22.084200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:22.119614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ceef3927-15fe-45c6-a077-6d092408ef89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051058 Sep 06 12:06:22.122268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1219/2486] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:22.588179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:22.590984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:22.597533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:22.598074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:22.598503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:22.599193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:22.599655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:22.600084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:22.631143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-73be5a28-22da-43cb-b4b8-143a3179d81e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047119 Sep 06 12:06:22.631744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1268/2487] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:23.134848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:23.137918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:23.144068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:23.144557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:23.144999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:23.145797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:23.146198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:23.146628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:23.179294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-25768ca3-dd34-4bea-bbcd-554d6b160187 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048992 Sep 06 12:06:23.179891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1220/2488] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:23.645040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:23.647237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:23.654143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:23.654630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:23.655067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:23.655754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:23.656211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:23.656637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:23.687464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a0bc0205-d447-4b77-9926-44b3fc920734 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Sep 06 12:06:23.688043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1269/2489] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:24.192546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:24.194874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:24.202001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:24.202493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:24.202935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:24.203630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:24.204083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:24.204508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:24.234461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e15285bb-e41e-463a-bd54-4e2769b1e303 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Sep 06 12:06:24.235037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1221/2490] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:24.700839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:24.703042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:24.709491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:24.710026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:24.710467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:24.712224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:24.712666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:24.713097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:24.743819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-20806ae8-3f83-47e4-98e4-d0e1eb25bfad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047589 Sep 06 12:06:24.744384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1270/2491] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:25.248811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:25.251126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:25.258322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:25.258943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:25.259388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:25.260098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:25.260591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:25.261760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:25.300566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5486f5a1-fa77-428a-baed-6e7f26e5b6cf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057069 Sep 06 12:06:25.301165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1222/2492] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:25.757576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:25.759765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:25.766884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:25.767375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:25.767814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:25.768506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:25.768960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:25.769383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:25.800334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4a310e0f-9f82-4356-9a8f-7994f296c4ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Sep 06 12:06:25.800903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1271/2493] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:26.313869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:26.317069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:26.325123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:26.325610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:26.326074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:26.326773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:26.327232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:26.327660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:26.360291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e61401fb-5e8b-4797-951f-191ff0af1e1f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050463 Sep 06 12:06:26.360864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1223/2494] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:26.814199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:26.816389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:26.822490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:26.823035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:26.823536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:26.824443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:26.824913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:26.825347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:26.829159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:26.860116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-487154ac-be78-4aa2-8002-4ec38af0950f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050251 Sep 06 12:06:26.860702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1272/2495] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:27.372758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:27.374948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:27.381580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:27.382128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:27.382563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:27.383255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:27.383700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:27.384120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:27.414800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-accf6117-69b2-402e-9136-dde851b87bf0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Sep 06 12:06:27.415365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1224/2496] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:27.873136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:27.875333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:27.881890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:27.882379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:27.882814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:27.883509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:27.883963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:27.884393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:27.915702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8cfa6d0-ccfb-4d98-986e-ead43f8f8ff4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047734 Sep 06 12:06:27.916267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1273/2497] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:28.427726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:28.429975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:28.436786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:28.437270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:28.437736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:28.438445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:28.438940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:28.439366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:28.472670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41d2411b-e52b-49c8-8fd2-d8736632f432 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049083 Sep 06 12:06:28.473240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1225/2498] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:28.928043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:28.930308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:28.936887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:28.937368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:28.937836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:28.938524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:28.938977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:28.939398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:28.970172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c599b039-0e81-413f-9de0-68e5eb69a691 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Sep 06 12:06:28.970743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1274/2499] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:29.486315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:29.488488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:29.495490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:29.496057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:29.496500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:29.497192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:29.497672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:29.498106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:29.528326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2e24a8f-21f3-4cc5-928b-a90aa3f31ff8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Sep 06 12:06:29.528814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1226/2500] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:29.983411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:29.985600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:29.987956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=58 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:29.993178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:29.993691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:29.994147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:29.994842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:29.995305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:29.995736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:30.027146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a229535e-cc76-40fb-aa8d-4a888bfea16c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 Sep 06 12:06:30.027738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1275/2501] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:30.540939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:30.543678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:30.550311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:30.550797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:30.551233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:30.551932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:30.552417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:30.552841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:30.583575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d2a81d74-4885-4080-a651-4519c5bbebd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046580 Sep 06 12:06:30.584367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1227/2502] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:31.039799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:31.042499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:31.048963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:31.049457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:31.049922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:31.050645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:31.051125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:31.051561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:31.081394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d56b8d6d-eab1-4185-ba08-e07571baaefd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Sep 06 12:06:31.081996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1276/2503] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:31.597633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:31.599764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:31.606878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:31.607364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:31.607790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:31.608466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:31.608912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:31.609331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:31.639553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b717e7e-66de-448e-9146-7f3a95a171fc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045842 Sep 06 12:06:31.640139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1228/2504] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:32.094798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:32.096941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:32.103443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:32.103934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:32.104375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:32.105069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:32.105527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:32.105986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:32.136868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41ef49d4-6694-4be2-8f88-856bdbfd5f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Sep 06 12:06:32.137440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1277/2505] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:32.652640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:32.654790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:32.661252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:32.661764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:32.662201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:32.662877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:32.663325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:32.663742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:32.693600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8a67bb01-0c2e-4428-b255-342b7488f0c7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Sep 06 12:06:32.694174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1229/2506] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:33.149595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:33.152496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:33.158969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:33.159457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:33.159898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:33.160589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:33.161047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:33.161474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:33.191819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e8369e3e-0e65-43fa-a037-489c997ce7ce tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Sep 06 12:06:33.192385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1278/2507] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:33.706233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:33.708384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:33.710660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=58 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:33.716173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:33.716671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:33.717096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:33.717890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:33.718254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:33.718670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:33.750527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-03f81c8c-f2db-4e0e-8cdb-acfba24c93b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Sep 06 12:06:33.751108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1230/2508] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:34.204531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:34.206807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:34.213352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:34.213892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:34.214342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:34.215032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:34.215490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:34.215919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:34.245927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-db43c8b1-8c5c-4afc-acd5-b75b712a3e5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Sep 06 12:06:34.246551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1279/2509] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:34.763441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:34.765628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:34.772091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:34.772580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:34.773275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:34.774012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:34.774472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:34.774902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:34.805613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6e47c39a-027b-4d0d-8d63-bedaf4b3b8de tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Sep 06 12:06:34.806215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1231/2510] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:35.259465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:35.263326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:35.270130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:35.270625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:35.271068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:35.271776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:35.272235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:35.272666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:35.304850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3bcecfb1-c9fb-4719-b776-0ef4f2092843 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049449 Sep 06 12:06:35.305483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1280/2511] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:35.818587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:35.820773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:35.827696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:35.828183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:35.828624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:35.829311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:35.829795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:35.830224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:35.856231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:35.861767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f13c3f22-8fc3-4523-8465-729c861f5a56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047124 Sep 06 12:06:35.862342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1232/2512] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:36.318492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:36.320635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:36.327776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:36.328265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:36.328707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:36.329396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:36.329883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:36.330317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:36.361496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f39db842-fe12-4ca8-b7f2-d0da3adb48a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047064 Sep 06 12:06:36.362118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1281/2513] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:36.876960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:36.879382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:36.888031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:36.888506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:36.888936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:36.889620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:36.890092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:36.890508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:36.922400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f2a4580c-1976-4cc4-be42-b29c5a3a2381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051538 Sep 06 12:06:36.922974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1233/2514] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:37.374448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:37.376621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:37.383083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:37.383576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:37.384018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:37.384709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:37.385169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:37.385600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:37.415029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-709b6bb2-0891-4d8d-9a3f-4ff0f68f9db9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Sep 06 12:06:37.415586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1282/2515] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:37.935461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:37.937638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:37.944087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:37.944571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:37.945012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:37.945723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:37.946182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:37.946608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:37.977691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-60c2c029-cc1b-464f-8daf-73ed3bef520d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Sep 06 12:06:37.978255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1234/2516] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:38.428731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:38.430911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:38.437428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:38.437959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:38.438418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:38.439096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:38.439546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:38.439962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:38.472400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-677b5094-4335-47ff-81fb-422f91053d31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Sep 06 12:06:38.472973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1283/2517] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:38.990792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:38.992980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:39.000086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:39.000604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:39.001043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:39.001757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:39.002213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:39.002639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:39.033298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-80e4cb35-d8ff-403d-ad76-da25965c53f5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046551 Sep 06 12:06:39.033891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1235/2518] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:39.486496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:39.488721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:39.495953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:39.496666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:39.497424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:39.498360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:39.498937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:39.499690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:39.531644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9cb28a47-56b1-4e3f-a773-ae0f90b99676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049407 Sep 06 12:06:39.532220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1284/2519] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:40.045925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:40.048107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:40.054617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:40.055104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:40.055549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:40.056244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:40.056705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:40.057167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:40.088154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8feee0b5-4a77-4422-b5d3-4dc4179103c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Sep 06 12:06:40.089363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1236/2520] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:40.544106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:40.546393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:40.552986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:40.553476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:40.553951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:40.554647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:40.555110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:40.555539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:40.586780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e1d997de-c165-47ad-980e-71ca0c7e58af tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Sep 06 12:06:40.587340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1285/2521] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:41.100642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:41.102866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:41.110049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:41.110540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:41.110982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:41.111697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:41.112155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:41.112586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:41.143063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e66264b4-2a95-40f9-b289-1677d3e84ee3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Sep 06 12:06:41.143555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1237/2522] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:41.599547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:41.601690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:41.608076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:41.608555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:41.608985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:41.609680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:41.610138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:41.610556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:41.641173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c61be5e3-600e-4fb7-9889-35993313677a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Sep 06 12:06:41.641788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1286/2523] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:42.155616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:42.157786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:42.164208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:42.164692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:42.165131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:42.165843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:42.166300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:42.167387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:42.199610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a97aafc0-b611-4d33-ba8a-209bf093125a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Sep 06 12:06:42.200186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1238/2524] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:42.653814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:42.655972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:42.662589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:42.663077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:42.663510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:42.664205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:42.664662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:42.665095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:42.694845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd0769eb-eb9f-4a7d-ae9b-80b9bdb1e64c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Sep 06 12:06:42.695397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1287/2525] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:43.212506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:43.214733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:43.221022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.221509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.221989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.222680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.223133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.223559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.254123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a06547c6-1aeb-46c2-8f43-4fd1f6c656e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Sep 06 12:06:43.254696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1239/2526] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:43.706860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:43.709028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:43.716023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.716500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.716936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.717611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:43.718087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:43.718506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:43.742919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:43.748687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50b50513-8a6e-47b4-822c-bc312967c990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Sep 06 12:06:43.749254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1288/2527] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:44.267390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:44.269549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:44.276245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:44.276727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:44.277160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:44.277873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:44.278325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:44.278743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:44.308245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-07afce7c-fa04-40d5-919d-f258347615b1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Sep 06 12:06:44.308790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1240/2528] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:44.760590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:44.762905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:44.769365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:44.769948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:44.770424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:44.771111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:44.771574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:44.771999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:44.802295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7769f884-faff-4f0a-ba1f-b063ea7586c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045670 Sep 06 12:06:44.802860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1289/2529] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:45.320833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:45.322923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:45.330395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:45.330882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:45.331318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:45.332003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:45.332458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:45.332880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:45.363624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a8f3077-c926-41be-bc3c-6befa1379a39 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046771 Sep 06 12:06:45.364188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1241/2530] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:45.815659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:45.817887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:45.826656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:45.827148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:45.827590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:45.828299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:45.828760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:45.829185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:45.859879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-419249f7-fe62-4883-839b-22bff8e1c195 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Sep 06 12:06:45.860384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1290/2531] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:46.376047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:46.378230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:46.384697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.385182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.385619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.386328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.386783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.387202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.417092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ce6276e-f481-4c71-9ed7-3cdfc972a084 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Sep 06 12:06:46.418387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1242/2532] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:46.871799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:46.873949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:46.880312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.880787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.881217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.882186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:46.882956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:46.884477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:46.915173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-949dd1e1-9001-4e01-ba20-d3a569b6512b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Sep 06 12:06:46.915731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1291/2533] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:47.431085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:06:47.433928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:47.440703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.441198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.441640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.442368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.442826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.443258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.548932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-849395f3-3639-4aaa-ab15-fa24efa805db tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/action" status: 200 len: 76213 microversion: 2.1 time: 0.121853 Sep 06 12:06:47.549517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1243/2534] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 12:06:47 2022] POST /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0/action => generated 76213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:06:47.927598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:47.929782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:47.936741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.937247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.937689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.938384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:47.938840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:47.939267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:47.969499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b4080613-ca6b-4661-a5c4-153d6b6fadf0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045802 Sep 06 12:06:47.970164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1292/2535] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:48.982872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:48.985112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:48.992329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:48.992812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:48.993304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:48.994031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:48.994505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:48.994953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:49.027396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d385432-332d-4693-9cd9-cf70e169300f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048240 Sep 06 12:06:49.028369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1244/2536] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:50.040185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:50.042906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:50.049400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:50.049941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:50.050381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:50.051184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:50.051650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:50.052080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:50.082875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9e7afcb-977e-4e16-bd84-ce74e4de9b80 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046537 Sep 06 12:06:50.083446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1293/2537] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:51.095630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:51.097789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:51.104121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:51.104599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:51.105393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:51.106018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:51.106466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:51.106884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:51.137176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c24d3c3-46f1-4916-867d-7aa109dff12f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Sep 06 12:06:51.137754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1245/2538] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:52.149920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:52.153218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:52.159656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:52.160142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:52.160616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:52.161265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:52.161758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:52.162190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:52.193488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af65abb5-4ccb-466d-92f3-9a6831328e87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Sep 06 12:06:52.194099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1294/2539] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:53.206080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:53.208555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:53.216249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:53.216735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:53.217175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:53.217975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:53.218432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:53.218855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:53.249267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5fb4d4c4-a6f7-42c7-9b9d-11a9a698aed4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Sep 06 12:06:53.249882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1246/2540] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:54.262150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:54.264314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:54.271250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:54.271737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:54.272268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:54.272879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:54.273586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:54.274071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:54.304528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e01acce5-f982-4aa9-ba14-3b6a59d7687f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Sep 06 12:06:54.305097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1295/2541] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:06:55.318181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:55.320510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:55.327916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:55.328548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:55.329064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:55.329909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:55.330367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:55.330818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:55.366829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-308fff82-55be-43d5-930e-b03945dbf709 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052814 Sep 06 12:06:55.367427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1247/2542] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:56.379941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:56.382356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:56.389513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:56.390057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:56.390512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:56.391220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:56.391683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:56.392110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:56.425261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8477f16-de53-45f7-bd4e-6c636d8fa772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049279 Sep 06 12:06:56.425891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1296/2543] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:57.439270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:57.441505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:57.447893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:57.448451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:57.449041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:57.449777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:57.450241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:57.450679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:57.480358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c5e3b07-afad-482a-9cfc-2d7a8fbc3d29 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Sep 06 12:06:57.480931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1248/2544] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:58.492944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:58.495152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:58.501957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:58.502450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:58.502888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:58.503587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:58.504040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:58.504465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:58.535262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b3d9950-bbea-400b-a75d-11c101eabe79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046302 Sep 06 12:06:58.535819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1297/2545] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:06:59.548460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:06:59.550653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:06:59.557427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:59.558138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:59.558588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:59.559310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:06:59.559770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:06:59.560202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:06:59.590063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:59.595560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-007da7ca-64ba-44b0-87b1-abc58b26d9c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051147 Sep 06 12:06:59.596178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1249/2546] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:06:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:00.608323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:00.610600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:00.614104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=46 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:00.617635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:00.618156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:00.618603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:00.619292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:00.619754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:00.620721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:00.656133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-238b27e8-0aa3-402b-b346-1a6f0eeb97d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051711 Sep 06 12:07:00.656729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1298/2547] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:01.669314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:01.671594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:01.679208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:01.679872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:01.680416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:01.681363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:01.681965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:01.683055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:01.715619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f2f43e0d-0385-4979-a1c7-373e60829849 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Sep 06 12:07:01.716200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1250/2548] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:02.727880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:02.730652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:02.736954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:02.737447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:02.737937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:02.738643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:02.739104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:02.739537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:02.770518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bea84cf7-4fdd-4fe9-b050-a390bf481288 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046580 Sep 06 12:07:02.771085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1299/2549] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:03.783212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:03.785409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:03.787742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=42 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:03.792895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:03.793384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:03.793856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:03.794559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:03.795194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:03.795785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:03.827857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3bca7913-d975-49c9-8b32-17bb69b4487a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048632 Sep 06 12:07:03.828426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1251/2550] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:04.841350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:04.843651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:04.850360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:04.850860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:04.851303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:04.852017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:04.852476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:04.852902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:04.891951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2bc0fc47-68a8-4afe-9155-f47685fd3231 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055222 Sep 06 12:07:04.892534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1300/2551] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:05.905875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:05.908207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:05.915244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:05.915742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:05.916176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:05.916975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:05.918358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:05.918492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:05.951109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0cc69e6d-63c1-4dad-9537-b47098aae47e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049975 Sep 06 12:07:05.951715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1252/2552] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:06.964083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:06.966245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:06.972650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:06.973129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:06.973562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:06.974266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:06.974715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:06.975133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:07.006511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-13e7e284-9471-412f-bc96-e2ba48a13862 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Sep 06 12:07:07.007079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1301/2553] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:08.019930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:08.022164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:08.030585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:08.031160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:08.031892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:08.033007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:08.033612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:08.034077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:08.069505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-818a0a6a-8d5d-4908-b4ba-dc3affcbe5ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053527 Sep 06 12:07:08.070127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1253/2554] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:09.082712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:09.084874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:09.091965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:09.092460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:09.092903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:09.093614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:09.094099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:09.094537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:09.128423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a3ce8c60-6d6f-4279-8e64-ef27e349daeb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049839 Sep 06 12:07:09.129009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1302/2555] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:10.140658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:10.142730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:10.149404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:10.149926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:10.150362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:10.151050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:10.151875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:10.152064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:10.184903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fabba798-f925-4444-a804-31f1570da3fb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Sep 06 12:07:10.185988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1254/2556] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:11.198480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:11.200573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:11.207575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:11.208097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:11.208539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:11.209292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:11.209786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:11.210214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:11.243686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3d0b926b-d670-4558-a566-458f106e0cc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049661 Sep 06 12:07:11.244279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1303/2557] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:12.256888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:12.259019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:12.266716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:12.267198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:12.267635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:12.268324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:12.268776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:12.269194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:12.310374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e731a47e-d0df-46b8-aac5-5850a4d64af9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057380 Sep 06 12:07:12.310965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1255/2558] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:13.323765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:13.326242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:13.328320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:07:13.328463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:07:13.330227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:07:13.330362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:07:13.339956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:13.340454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:13.340900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:13.341610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:13.342104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:13.342533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:13.384922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a7337a4-4ad6-4ead-9549-4bc3ede80724 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065498 Sep 06 12:07:13.386646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1304/2559] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:14.402796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:14.404844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:14.411576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:14.412072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:14.412514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:14.413218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:14.413715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:14.414235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:14.449708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b353e5fb-072a-4ed3-9054-de9425be97e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050609 Sep 06 12:07:14.450305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1256/2560] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:15.461786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:15.464664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:15.471806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:15.472224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:15.472664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:15.473387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:15.473884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:15.474315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:15.477137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=97 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:15.508938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3de99f46-4ad6-4384-8e36-112975f13ab5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051221 Sep 06 12:07:15.509538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1305/2561] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:16.521939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:16.524458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:16.532704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:16.533102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:16.533537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:16.534275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:16.534729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:16.535158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:16.575071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2665ad0d-40b2-4760-9646-d7c70135c249 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057271 Sep 06 12:07:16.575656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1257/2562] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:17.587967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:17.591214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:17.601532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:17.602352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:17.603000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:17.603894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:17.604361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:17.604815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:17.642619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-baf8c6ba-365d-4d96-a4f5-c1b4e2b15430 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058603 Sep 06 12:07:17.643235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1306/2563] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:18.655691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:18.657968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:18.659922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:07:18.660053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:07:18.666293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:18.666814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:18.667670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:18.668581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:18.668581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:18.668770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:18.701813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7c58234d-2c80-435c-af41-97e369ff10bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049979 Sep 06 12:07:18.702400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1258/2564] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:19.714708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:19.716920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:19.724004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:19.724571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:19.725075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:19.725960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:19.726465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:19.726910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:19.762435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e5f49e09-eb8c-4766-921e-0b996e80d790 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051681 Sep 06 12:07:19.763013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1307/2565] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:20.775604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:20.778515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:20.785547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:20.786083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:20.786531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:20.787271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:20.787732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:20.788164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:20.822326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6212df0-e736-4c34-ad33-2007f25c64ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051101 Sep 06 12:07:20.822923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1259/2566] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:21.834827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:21.836887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:21.844150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:21.844668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:21.845102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:21.845840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:21.846293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:21.846712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:21.880819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9a8f1fe-4d26-4295-bb65-98c3aeeb1e24 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049989 Sep 06 12:07:21.881420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1308/2567] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:22.892372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:22.894544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:22.901334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:22.901862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:22.902323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:22.903046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:22.903539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:22.903957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:22.935655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34cbc40e-169b-41b7-b133-61f2c9bdbbfc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047074 Sep 06 12:07:22.936118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1260/2568] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:23.947657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:23.950029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:23.956521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:23.957009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:23.957454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:23.958179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:23.958638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:23.959070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:23.990818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-38ea19b4-f7b6-490e-9849-6ebb00947311 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047059 Sep 06 12:07:23.991385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1309/2569] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:25.003690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:25.005906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:25.013133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:25.013622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:25.014087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:25.014792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:25.015246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:25.015758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:25.048966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-267cba61-a712-4606-b5d7-19a5755cb93e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049264 Sep 06 12:07:25.049512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1261/2570] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:26.062171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:26.064300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:26.070294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:26.070778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:26.071209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:26.071885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:26.072333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:26.072792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:26.102272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed2cfb6d-08ca-4837-be29-7b788dd840ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Sep 06 12:07:26.102834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1310/2571] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:27.115774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:27.117966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:27.125078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:27.125567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:27.126046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:27.126832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:27.127424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:27.128000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:27.159908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f089128a-e25a-4632-b762-d5d190650cd0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048263 Sep 06 12:07:27.160490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1262/2572] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:28.172881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:28.175080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:28.181266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:28.181782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:28.182909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:28.183713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:28.184193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:28.184617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:28.214115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-40c4c64d-9ddb-40cb-b89e-5d31a679b04b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044954 Sep 06 12:07:28.214692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1311/2573] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:29.226977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:29.229167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:29.235849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:29.236325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:29.236756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:29.237441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:29.237911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:29.238336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:29.269009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6af41377-72bb-4664-ab6f-a3966fd3a323 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045967 Sep 06 12:07:29.269572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1263/2574] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:30.282411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:30.284769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:30.290919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:30.291498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:30.291945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:30.292653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:30.293119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:30.293542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:30.326199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efea83ea-075c-471f-a976-a1cdc555a0a4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047557 Sep 06 12:07:30.326773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1312/2575] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:31.339307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:31.341566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:31.348389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:31.348876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:31.349202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:31.349949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:31.350376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:31.351029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:31.388849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-79572549-42b4-4027-bdc6-973c83639f4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054022 Sep 06 12:07:31.389429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1264/2576] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:32.400768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:32.403515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:32.406646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:32.412043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:32.412539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:32.413023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:32.413706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:32.414173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:32.414603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:32.446461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-62ffd995-0b19-46d2-a92a-7a05591e53a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049906 Sep 06 12:07:32.447026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1313/2577] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:33.459417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:33.461571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:33.468669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:33.469151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:33.469590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:33.470312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:33.470770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:33.471196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:33.474850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=91 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:33.501542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-321e011a-3eed-453a-ae94-346cc37240a6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Sep 06 12:07:33.502137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1265/2578] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:34.515037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:34.517278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:34.524172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:34.524692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:34.525126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:34.525846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:34.526297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:34.526716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:34.558331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c02523ac-7cfa-4e8f-a971-7d4f96d1f6ef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047930 Sep 06 12:07:34.559574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1314/2579] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:35.571581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:35.573755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:35.576614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=30 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:35.581938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:35.582430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:35.582867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:35.583567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:35.584021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:35.584444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:35.615381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-916626a7-0b3c-42e2-836b-3aae778fd703 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Sep 06 12:07:35.615941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1266/2580] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:36.628103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:36.630288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:36.636914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:36.637508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:36.637904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:36.638620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:36.639085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:36.639515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:36.672658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-02e639b4-7e51-4b8a-bb25-b022d8831310 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Sep 06 12:07:36.673517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1315/2581] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:37.686168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:37.688353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:37.694860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:37.695343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:37.695774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:37.696459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:37.696909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:37.697326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:37.727264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d582a283-8440-4d8a-934e-69f31ca2aaa4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Sep 06 12:07:37.727811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1267/2582] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:38.740227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:38.742462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:38.749811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:38.750311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:38.750753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:38.751460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:38.751917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:38.752345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:38.784200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cb02de62-d708-42c8-b7cd-ca8087093639 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047986 Sep 06 12:07:38.784943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1316/2583] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:39.797067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:39.799382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:39.805871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:39.806368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:39.806810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:39.807506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:39.807963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:39.808388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:39.839814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6e1405f-b561-4dce-ab4a-0b34528c53bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Sep 06 12:07:39.841075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1268/2584] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:40.853104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:40.855274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:40.862584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:40.863069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:40.863503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:40.864184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:40.864630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:40.865045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:40.896039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8b685f33-4742-4e8b-a7e0-3cf398f84533 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Sep 06 12:07:40.901119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1317/2585] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:41.909628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:41.911890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:41.919719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:41.920221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:41.920662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:41.921356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:41.921842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:41.922267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:41.953431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b183fd18-6662-400d-90b9-60fcaef7ecf3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047820 Sep 06 12:07:41.953871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1269/2586] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:07:42.966100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:42.968206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:42.974790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:42.975265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:42.975699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:42.976367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:42.976813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:42.977235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:43.008124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-423ed843-ceda-4f04-8876-0e7d071d7f09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Sep 06 12:07:43.008707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1318/2587] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:44.020404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:44.022584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:44.029928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:44.030411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:44.030844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:44.031523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:44.031973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:44.032387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:44.063142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1c5ce79-26c9-4b7c-9244-83b9dab77e81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046624 Sep 06 12:07:44.063712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1270/2588] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:07:45.075807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:45.077977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:45.084537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:45.085023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:45.085458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:45.086548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:45.087001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:45.087425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:45.119529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-769f3e65-b3bf-4e7b-bcee-987885f6e6d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Sep 06 12:07:45.120402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1319/2589] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:46.133571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:46.135790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:46.142841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:46.143335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:46.143777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:46.144472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:46.144929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:46.145356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:46.178871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1ddac67e-4167-4d48-9a1a-f810585f49f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049278 Sep 06 12:07:46.179636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1271/2590] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:47.191546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:47.193717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:47.200222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:47.200695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:47.201141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:47.201865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:47.202327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:47.202760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:47.205121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=90 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:47.234329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89620fab-fa96-42a7-af8d-8df9fd9b2962 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Sep 06 12:07:47.235120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1320/2591] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:48.252809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:48.252809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:48.261180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:48.261710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:48.262713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:48.264126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:48.264771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:48.265203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:48.298945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a9259252-770e-4cfc-824c-cd13946bc2b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055876 Sep 06 12:07:48.299532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1272/2592] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:49.312317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:49.314520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:49.321235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:49.321618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:49.322088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:49.322776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:49.323232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:49.323654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:49.354983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6964b915-61a5-4a0d-810f-0e9e14ecc463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Sep 06 12:07:49.355722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1321/2593] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:50.367008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:50.369175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:50.376200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:50.376679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:50.377111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:50.377819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:50.378268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:50.378686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:50.408835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81fcdcb1-fac5-4dfe-a787-bbdebca3d5b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Sep 06 12:07:50.409551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1273/2594] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:51.421497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:51.423678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:51.430100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:51.430590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:51.431028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:51.431721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:51.432176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:51.432600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:51.463688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5dcaf95e-a070-41c3-b902-5b32562b1c5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046889 Sep 06 12:07:51.464237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1322/2595] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:52.475645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:52.477863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:52.485297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:52.485822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:52.486261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:52.486936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:52.487429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:52.487990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:52.521262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0d5d9321-4566-47d9-bd39-49ed5c003f71 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049454 Sep 06 12:07:52.521888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1274/2596] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:53.534759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:53.536940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:53.543485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:53.543971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:53.544415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:53.545108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:53.545566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:53.546015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:53.576220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e7337246-fea4-4a3e-8127-0fa3d81889b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Sep 06 12:07:53.576784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1323/2597] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:54.588424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:54.591416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:54.597715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:54.598204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:54.598646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:54.599340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:54.599794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:54.600224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:54.635893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-21a66f05-d012-48fd-9726-042f09594e7e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Sep 06 12:07:54.635893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1275/2598] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:55.644445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:55.646680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:55.653928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:55.654418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:55.654848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:55.655540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:55.655984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:55.656404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:55.687527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ebebeaf-c946-4be6-9cb2-399d8c1eee86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046866 Sep 06 12:07:55.688010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1324/2599] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:56.700394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:56.702810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:56.709230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:56.709748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:56.710193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:56.710889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:56.711344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:56.711769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:56.743380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-df437bcd-8497-4416-9f96-df707017f44f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047439 Sep 06 12:07:56.744095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1276/2600] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:57.756373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:57.758523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:57.765818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:57.766313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:57.766761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:57.767492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:57.767952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:57.768459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:57.800067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae29926a-2074-4144-aca0-ef82e01c6ac1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047627 Sep 06 12:07:57.800633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1325/2601] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:58.812695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:58.814904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:58.821562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:58.822088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:58.822532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:58.823232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:58.823723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:58.824105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:58.855795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e5e6a62a-a2a2-400a-8d7e-2cfaaab0b449 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Sep 06 12:07:58.856410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1277/2602] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:07:59.868688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:07:59.870904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:07:59.877701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:59.878199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:59.878640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:59.879341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:07:59.879801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:07:59.880226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:07:59.911810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-75b6f1f2-c1c7-446e-b3ab-66565a0b50a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Sep 06 12:07:59.912399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1326/2603] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:07:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:00.924673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:00.926835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:00.933236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:00.933751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:00.934821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:00.935501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:00.935945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:00.936364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:00.967182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c5219cd1-9f66-47c0-b0a9-c5f35d48d269 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Sep 06 12:08:00.967771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1278/2604] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:01.979718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:01.982120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:01.988456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:01.988935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:01.989366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:01.990079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:01.990528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:01.990943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:02.021406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-52ce702e-f648-494b-bad8-f9c5404b2f9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Sep 06 12:08:02.022008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1327/2605] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:03.034832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:03.036896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:03.044113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:03.044706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:03.045153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:03.045886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:03.046347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:03.046778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:03.075983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc758b31-e573-43b1-a659-6022497ba3e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Sep 06 12:08:03.076557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1279/2606] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:04.088700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:04.091715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:04.094077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:04.099850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:04.100340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:04.100782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:04.101484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:04.101994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:04.102427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:04.132622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5d3a8c2d-0231-4b17-b8af-51f2cfc9260b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047978 Sep 06 12:08:04.133202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1328/2607] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:05.145816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:05.147856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:05.154743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:05.155223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:05.155660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:05.156345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:05.156794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:05.157212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:05.159613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=90 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:05.190098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-33281d53-6ed5-4243-8d2c-b9ed474073c4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048334 Sep 06 12:08:05.190689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1280/2608] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:06.203027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:06.205199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:06.211707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:06.212218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:06.212656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:06.213344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:06.213829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:06.214253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:06.243940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6390a575-e495-4380-865d-8bf96da17eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Sep 06 12:08:06.244731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1329/2609] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:07.257104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:07.259306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:07.261594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=30 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:07.268594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:07.269083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:07.269523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:07.270250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:07.270708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:07.271132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:07.302110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d2372a7d-4e89-4d72-8a3f-0245ecf7c71f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049019 Sep 06 12:08:07.302687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1281/2610] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:08.314819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:08.316886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:08.323311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:08.323789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:08.324604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:08.324903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:08.325352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:08.325802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:08.356172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-98384fec-a921-4ebf-9d0d-68c594c3480f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Sep 06 12:08:08.357121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1330/2611] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:09.369456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:09.372640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:09.378938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:09.379428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:09.379867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:09.380571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:09.381026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:09.381452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:09.414408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f783634-c7b4-4268-893c-62f7f8ba1230 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Sep 06 12:08:09.414999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1282/2612] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:10.427313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:10.429502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:10.436086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:10.436563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:10.436992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:10.437694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:10.438152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:10.438569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:10.467755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49367f3e-2aa3-46e4-8ca3-ae950b67ab09 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Sep 06 12:08:10.468295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1331/2613] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:08:11.480331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:11.483049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:11.489431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:11.489932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:11.490367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:11.491045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:11.491492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:11.491909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:11.521927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32e164d4-8d2f-46f5-8202-daad2a708e32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Sep 06 12:08:11.522499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1283/2614] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:12.535499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:12.537549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:12.544546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:12.545030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:12.545472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:12.546193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:12.546653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:12.547078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:12.577187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71a59279-b97d-40a3-93ef-0a0a6b4c3e8c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Sep 06 12:08:12.577830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1332/2615] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:13.590792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:13.592976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:13.599414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:13.599905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:13.600350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:13.601046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:13.601513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:13.601976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:13.631747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eb540cb2-99fa-4a67-a67c-c67c97968b0b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Sep 06 12:08:13.632316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1284/2616] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:14.643869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:14.646041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:14.653480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:14.654082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:14.654526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:14.655225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:14.655689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:14.656116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:14.688131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b6dd67d5-1796-4a0a-937c-f78192e70b6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048156 Sep 06 12:08:14.688632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1333/2617] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:15.700798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:15.703084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:15.710486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:15.710970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:15.711408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:15.712098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:15.712551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:15.713001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:15.742996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e2f364bf-540a-4f8f-8cb6-5e8461ae7214 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 Sep 06 12:08:15.743574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1285/2618] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:16.756265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:16.758389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:16.765344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:16.765866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:16.766310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:16.767008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:16.767468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:16.767897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:16.799375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fba29222-6f73-400f-b24c-1d911fa5632a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Sep 06 12:08:16.799952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1334/2619] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:17.812199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:17.814377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:17.820686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:17.821169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:17.821608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:17.822433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:17.822889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:17.823315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:17.853743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-87242993-8b8d-4554-a378-9113853f1490 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Sep 06 12:08:17.854332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1286/2620] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:18.866886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:18.869179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:18.875778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:18.876266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:18.876705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:18.877402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:18.877887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:18.878317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:18.881939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=90 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:18.909890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7634d6ca-cbb6-497d-9a8d-efa12e179070 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046862 Sep 06 12:08:18.910462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1335/2621] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:19.922346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:19.924486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:19.930837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:19.931321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:19.931746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:19.932422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:19.932869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:19.933294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:19.964054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a7a239c-1563-4285-8cee-c7e82e6d1642 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Sep 06 12:08:19.964642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1287/2622] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:20.977400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:20.979608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:20.986852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:20.987342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:20.987786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:20.988533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:20.988945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:20.989383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:21.020932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-159cedda-096b-4117-9089-a46534305acc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047432 Sep 06 12:08:21.021505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1336/2623] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:22.033322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:22.035548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:22.042068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:22.042560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:22.043345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:22.043968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:22.044451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:22.044865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:22.075040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d24502fc-316b-4612-a486-9966adc6a306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Sep 06 12:08:22.075040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1288/2624] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:23.086901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:23.089095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:23.096149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:23.096648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:23.097093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:23.097824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:23.098287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:23.098720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:23.130068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-77be8bcc-3c5d-4f9e-9bfc-b6465a9e2208 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046942 Sep 06 12:08:23.130751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1337/2625] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:24.143423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:24.145623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:24.152635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:24.153128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:24.153571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:24.154307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:24.154769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:24.155200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:24.187009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-510b846b-31cb-4d68-a5ef-78348088a2d4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047541 Sep 06 12:08:24.187488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1289/2626] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:25.199283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:25.201628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:25.208586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:25.209105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:25.209574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:25.210306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:25.210769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:25.211200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:25.240939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfa85b9d-3b4a-4b50-b677-9313b2c32743 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045628 Sep 06 12:08:25.241506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1338/2627] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:26.253970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:26.256111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:26.262662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:26.263859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:26.264307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:26.265032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:26.265488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:26.265951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:26.297385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-95930837-1406-42ca-b714-441d054f38ca tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Sep 06 12:08:26.297899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1290/2628] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:27.310022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:27.312226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:27.318281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:27.318761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:27.319191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:27.319938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:27.320389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:27.320804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:27.350973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-11f69b1c-7556-4f46-8a4b-7a291b63ec0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044886 Sep 06 12:08:27.351452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1339/2629] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:28.364190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:28.366394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:28.373428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:28.373881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:28.374326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:28.375013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:28.375496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:28.375929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:28.406708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7c5000da-8ffd-4ab3-a834-ef65c50493be tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 Sep 06 12:08:28.407273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1291/2630] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:29.419785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:29.421978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:29.430910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:29.431408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:29.431848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:29.432553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:29.435360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:29.435798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:29.466906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4decab1d-0bd3-4dfb-9365-89f7891f7d4d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051507 Sep 06 12:08:29.467380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1340/2631] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:30.478642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:30.480769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:30.487191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:30.487670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:30.488107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:30.488778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:30.489224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:30.489665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:30.519634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-36668b09-93f0-4b38-984b-b3a7078ad984 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Sep 06 12:08:30.520107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1292/2632] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:31.532691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:31.534785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:31.541222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:31.541729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:31.542163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:31.542842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:31.543290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:31.543710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:31.572626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3236a958-770c-4146-899e-bf5c987d865e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Sep 06 12:08:31.573168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1341/2633] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:32.585415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:32.587513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:32.594118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:32.594595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:32.595025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:32.595703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:32.596150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:32.596567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:32.626579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-326fe310-f84a-42f0-be85-b03bb1002eee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Sep 06 12:08:32.627141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1293/2634] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:33.642648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:33.644811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:33.651591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:33.652080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:33.652523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:33.653828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:33.654412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:33.654627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:33.684492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ddc78556-9968-4f3c-9177-3bd9dd756306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046294 Sep 06 12:08:33.685210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1342/2635] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:34.697286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:34.699477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:34.705995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:34.706478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:34.706916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:34.707600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:34.708052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:34.708476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:34.737867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7783840e-61ba-4527-ae23-7f4bad5371c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Sep 06 12:08:34.738411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1294/2636] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:35.751890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:35.754059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:35.756358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:35.761554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:35.762082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:35.762523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:35.763883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:35.764348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:35.764775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:35.794522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1505eb3e-0c1b-4636-93c8-6cf32d95e033 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047913 Sep 06 12:08:35.795120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1343/2637] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:36.807811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:36.810011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:36.816859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:36.817352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:36.817830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:36.818541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:36.819002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:36.819436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:36.821978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=90 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:36.852100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69a9785f-99f6-4686-85a6-c5b625dad2cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048228 Sep 06 12:08:36.852684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1295/2638] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:37.864755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:37.866991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:37.874356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:37.874845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:37.875279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:37.875968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:37.876418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:37.876842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:37.909022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7435b5b5-8e65-4882-b2b9-217d5b282eed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048104 Sep 06 12:08:37.909701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1344/2639] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:08:38.924773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:38.926982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:38.929009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=30 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:38.935101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:38.935639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:38.936112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:38.936823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:38.937280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:38.937738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:38.969716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-feec36c1-29d1-4ddc-9c82-9876abb29464 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Sep 06 12:08:38.970321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1296/2640] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:39.982812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:39.984955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:39.991570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:39.992061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:39.992502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:39.993196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:39.993664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:39.994104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:40.024941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab763d86-3361-4daf-a0d6-b8209295db6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Sep 06 12:08:40.025508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1345/2641] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:41.038840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:41.041013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:41.047673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:41.048167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:41.048608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:41.049299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:41.049782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:41.050215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:41.081884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0eb01a0-d157-4965-adfb-4fca490e172e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Sep 06 12:08:41.082436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1297/2642] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:42.095378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:42.097545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:42.104129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:42.104587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:42.105029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:42.105753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:42.106221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:42.106787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:42.136641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-16999507-c3c2-4169-961e-88de63364c89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Sep 06 12:08:42.137202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1346/2643] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:43.150022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:43.152216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:43.159232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:43.159724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:43.160165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:43.160865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:43.161327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:43.161789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:43.192022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-93f7ca88-1a17-4b42-a713-a59d39563061 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Sep 06 12:08:43.192589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1298/2644] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:44.205542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:44.207765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:44.214279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:44.214767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:44.215209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:44.215902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:44.216355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:44.216782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:44.246542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36818e09-c915-4f6f-9239-b0f2b7b8aa95 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Sep 06 12:08:44.247108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1347/2645] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:45.259986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:45.262222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:45.269630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:45.270165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:45.270600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:45.271300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:45.271761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:45.272189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:45.302266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7726adbf-9f64-4a6d-b0bc-e44002990eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046213 Sep 06 12:08:45.302841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1299/2646] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:46.314236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:46.316371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:46.322737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:46.323211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:46.323644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:46.324318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:46.324767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:46.325182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:46.355762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b62b5595-5d33-459b-9b95-aecdd7f464ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Sep 06 12:08:46.356327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1348/2647] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:47.369257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:47.371504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:47.373538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:08:47.373841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:08:47.380741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:47.381231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:47.381727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:47.382401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:47.382858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:47.383288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:47.414445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e58e4bbd-e74d-4dee-b895-d9f61225fead tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Sep 06 12:08:47.415025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1300/2648] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:48.427488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:48.429772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:48.436318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:48.436816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:48.437261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:48.437988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:48.438451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:48.438880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:48.469664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2451273c-a618-4b5d-b0a0-ce7c9c099d56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 Sep 06 12:08:48.470267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1349/2649] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:49.482327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:49.484585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:49.491122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:49.491615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:49.492055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:49.492742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:49.493195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:49.493624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:49.529963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c3754732-de3c-48d5-8c88-ba51735ebc89 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051418 Sep 06 12:08:49.530483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1301/2650] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:50.542802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:50.544880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:50.552136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:50.552634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:50.553074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:50.553798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:50.554253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:50.554679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:50.557166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=90 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:50.587609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88a625f7-b55c-4436-ad34-eb2f3f768e85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048853 Sep 06 12:08:50.588176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1350/2651] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:51.599873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:51.602017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:51.609273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:51.609783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:51.610218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:51.610927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:51.611384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:51.611798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:51.641015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66be32d3-b236-4fd4-9e3a-4b7b7f471dc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 06 12:08:51.641590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1302/2652] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:52.654090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:52.657410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:52.663946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:52.664426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:52.664905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:52.665616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:52.666091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:52.666516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:52.696025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1d788de1-fdf7-4d47-a539-4002f9d8c45e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Sep 06 12:08:52.696593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1351/2653] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:53.709032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:53.711221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:53.718350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:53.718954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:53.719384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:53.720066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:53.720515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:53.720936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:53.751748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc2a598a-2c86-45af-92d8-518f46b5c6b9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Sep 06 12:08:53.752305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1303/2654] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:54.764993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:54.767189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:54.774597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:54.775208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:54.775651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:54.776420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:54.776812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:54.777245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:54.807701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af392572-df2b-434f-8204-4cd952f04c31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047315 Sep 06 12:08:54.808278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1352/2655] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:55.820805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:55.823075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:55.831597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:55.832121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:55.832562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:55.833273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:55.833763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:55.834194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:55.882520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9d4b55de-fd04-4f78-931b-ee68ed5ffc7b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065221 Sep 06 12:08:55.883248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1304/2656] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:56.895781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:56.898113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:56.904482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:56.905485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:56.906005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:56.906677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:56.907139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:56.907568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:56.939036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a9bd45b0-f651-4ec6-9488-a26e58d48d91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047356 Sep 06 12:08:56.939617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1353/2657] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:57.952066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:57.954296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:57.960626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:57.961104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:57.961535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:57.962235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:57.962682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:57.963097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:57.992561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2015790-0718-441f-a26d-1c1de36f3db7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Sep 06 12:08:57.993111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1305/2658] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:08:59.005508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:08:59.007656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:08:59.013998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:59.015393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:59.015706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:59.016393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:08:59.016841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:08:59.017259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:08:59.046678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-28f1361d-24a9-4673-ae6f-64f5cb147900 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Sep 06 12:08:59.047234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1354/2659] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:08:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:00.059504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:00.061951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:00.069063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:00.069552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:00.070018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:00.070723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:00.071171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:00.071588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:00.106003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cfa5e389-cfb1-4a06-aec2-5dd8fa1e5702 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050364 Sep 06 12:09:00.107673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1306/2660] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:01.119358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:01.121558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:01.128908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:01.129408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:01.129894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:01.130608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:01.131071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:01.131503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:01.164741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a14722d0-309d-4bab-906a-620ea75aa518 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049333 Sep 06 12:09:01.165337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1355/2661] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:02.179353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:02.183359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:02.192078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:02.192641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:02.193078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:02.194040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:02.194560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:02.195057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:02.229102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b23f9fc-0e58-4008-9ff5-d25bb64de0a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055813 Sep 06 12:09:02.229691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1307/2662] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:03.242134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:03.244313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:03.252599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:03.252599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:03.252938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:03.253664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:03.254128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:03.254551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:03.290052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-06ab3d98-79d1-4567-9a5a-d6cd2c45efc6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051909 Sep 06 12:09:03.290643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1356/2663] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:04.302362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:04.304512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:04.311675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:04.312170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:04.312605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:04.313297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:04.313783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:04.314207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:04.344893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8dba2a58-cce7-427a-8b9b-c30ed82eadcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046450 Sep 06 12:09:04.345461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1308/2664] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:05.358627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:05.360959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:05.367748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:05.368243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:05.368686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:05.369392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:05.369894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:05.370327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:05.412212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-239c3d3b-7091-42ca-a4c4-3cf26fb96024 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058967 Sep 06 12:09:05.412791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1357/2665] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:06.424983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:06.427183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:06.433830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:06.434318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:06.434748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:06.435436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:06.436387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:06.436828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:06.467418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d016b7fa-25bd-447b-b1db-2809e0ecdf5d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Sep 06 12:09:06.468173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1309/2666] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:07.480845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:07.483675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:07.486133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:07.491471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:07.491968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:07.492408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:07.493115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:07.493572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:07.494037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:07.525310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e837d74f-02cb-4268-9427-d154ea9cb36c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048315 Sep 06 12:09:07.525816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1358/2667] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:08.539029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:08.541403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:08.548929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:08.549421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:08.549895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:08.550723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:08.551185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:08.551619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:08.554252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=90 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:08.583754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4d93fbc0-cc71-4a29-863e-664110da7b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048557 Sep 06 12:09:08.584348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1310/2668] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:09.597047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:09.599276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:09.605954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:09.606445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:09.606888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:09.607587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:09.608062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:09.608499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:09.641526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7751d234-1c1e-488d-9f92-0bb1fc783c81 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049029 Sep 06 12:09:09.642136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1359/2669] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:10.656984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:10.659303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:10.661207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=30 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:10.666502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:10.666999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:10.667442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:10.668146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:10.668606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:10.669036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:10.698945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d1e5ecb-d04b-429b-879a-7b98b2f1b359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046672 Sep 06 12:09:10.699507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1311/2670] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:11.712126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:11.714324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:11.721206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:11.721825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:11.722182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:11.722947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:11.723319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:11.723747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:11.754057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-520f03cf-6ddf-460e-8046-6f8007bf428f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Sep 06 12:09:11.754623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1360/2671] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:12.767654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:12.769967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:12.776716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:12.777207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:12.777658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:12.778480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:12.778810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:12.779233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:12.817124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fce84b35-eaf6-416c-a2d7-6fb5498aca44 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054435 Sep 06 12:09:12.817732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1312/2672] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:13.830502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:13.832728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:13.840123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:13.840618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:13.841055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:13.841785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:13.842292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:13.842725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:13.883754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f88c6e24-41bd-4675-a062-d81599bd9687 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058357 Sep 06 12:09:13.884337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1361/2673] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:14.897090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:14.899386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:14.906636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:14.907133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:14.907569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:14.908280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:14.908733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:14.909161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:14.940505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3aa86222-101f-43a1-b22f-6aae16d7acaf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047305 Sep 06 12:09:14.941070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1313/2674] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:15.954672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:15.956849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:15.963778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:15.964282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:15.964729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:15.965431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:15.965929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:15.966371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:16.000440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5badbfd9-3ba7-4f7a-aa33-6f86d013f898 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051739 Sep 06 12:09:16.001209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1362/2675] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:17.012287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:17.014816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:17.021067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:17.021551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:17.022016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:17.022704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:17.023151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:17.023564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:17.055435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f37b8f45-b7c5-4c69-9613-78999ff7aff9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Sep 06 12:09:17.055994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1314/2676] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:18.067939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:18.070120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:18.076526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:18.077020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:18.077447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:18.078159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:18.078610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:18.079032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:18.109550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f1f1a5f8-51d8-444e-8882-c5a7a54e2979 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Sep 06 12:09:18.110202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1363/2677] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:19.122507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:19.125475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:19.132752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:19.133249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:19.133718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:19.134460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:19.134919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:19.135347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:19.166148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cb2d2101-3743-465c-b80d-c6cf2bc4c4b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047782 Sep 06 12:09:19.166991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1315/2678] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:20.190110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:20.192068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:20.198540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:20.199017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:20.199446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:20.200130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:20.200577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:20.200995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:20.231381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8a28eb86-89ac-42ee-9cce-47412596c20a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Sep 06 12:09:20.231936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1364/2679] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:21.243495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:21.245759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:21.253263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:21.253790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:21.254238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:21.255053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:21.255517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:21.255954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:21.292542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fccf0f97-62cd-478c-9161-d6854f6e17aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052898 Sep 06 12:09:21.293369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1316/2680] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:22.308836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:22.311179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:22.318616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:22.319394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:22.319864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:22.320586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:22.321040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:22.321496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:22.324232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=90 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:22.353509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89ac34cf-0af7-4917-bfb8-4a6c98171f55 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 Sep 06 12:09:22.354133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1365/2681] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:23.366107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:23.368286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:23.375451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:23.375940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:23.376394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:23.377605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:23.377605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:23.377979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:23.408761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b5a6c4a1-65ee-4cc9-81dd-942ed5c3f196 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Sep 06 12:09:23.409337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1317/2682] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:24.420894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:24.423217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:24.430004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:24.430499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:24.430927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:24.431620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:24.432719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:24.433151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:24.468584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f46e1d3-a36b-4a13-b765-c63d3fc62ecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051753 Sep 06 12:09:24.469399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1366/2683] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:25.481294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:25.483479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:25.490910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:25.491391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:25.491821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:25.492541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:25.492986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:25.493440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:25.523836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5b132bf4-f695-4405-87c8-c2d7fd19e078 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Sep 06 12:09:25.524406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1318/2684] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:26.536302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:26.538486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:26.544465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:26.544950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:26.545397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:26.546115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:26.546575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:26.547591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:26.579344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4bbbd74b-9c81-4966-ac36-1d4aade11371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046423 Sep 06 12:09:26.579923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1367/2685] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:27.591973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:27.594575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:27.601766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:27.602261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:27.602704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:27.603401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:27.603859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:27.604286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:27.636131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0fd14f97-86c9-4d43-94e2-208df5895d14 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Sep 06 12:09:27.636720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1319/2686] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:28.649012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:28.651351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:28.658128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:28.658612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:28.659043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:28.659730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:28.660178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:28.660596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:28.692714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-631ba2b7-1c18-401c-8b70-946a9ab2e505 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047704 Sep 06 12:09:28.693295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1368/2687] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:29.706121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:29.708316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:29.714842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:29.715341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:29.715784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:29.716488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:29.716990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:29.717418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:29.753089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0002e8f-f58a-4d14-a01d-1bfb4779ab50 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051699 Sep 06 12:09:29.753695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1320/2688] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:30.766258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:30.768527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:30.775173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:30.775651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:30.776081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:30.776764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:30.777218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:30.777630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:30.808370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f1b3c9ea-4c3b-481c-87d2-9f955a7f04f8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Sep 06 12:09:30.809126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1369/2689] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:31.820702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:31.822763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:31.831171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:31.831666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:31.832110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:31.832815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:31.833274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:31.833762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:31.864223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d1dd04d0-4633-4e91-869b-266576b77148 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047625 Sep 06 12:09:31.864792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1321/2690] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:32.877913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:32.879979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:32.886609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:32.887092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:32.887525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:32.888214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:32.888663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:32.889081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:32.919939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ef2754a-9ffb-405d-85cd-c2ea58e84519 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Sep 06 12:09:32.920514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1370/2691] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:33.933975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:33.936586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:33.946693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:33.947423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:33.948088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:33.949129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:33.949853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:33.950482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:33.980038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9e31afc-b6e1-4f95-bb5a-81ef9ff9b05c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050918 Sep 06 12:09:33.980589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1322/2692] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:34.992696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:34.994998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:35.002201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:35.002713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:35.003148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:35.003840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:35.004294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:35.004717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:35.035200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7723fb99-b7f8-4e41-a83b-e11009a44e1c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Sep 06 12:09:35.035757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1371/2693] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:36.048099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:36.050378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:36.056850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:36.057328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:36.057793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:36.058474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:36.058918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:36.059336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:36.090649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae7832c1-8f67-4abc-84aa-99f0c184a4b4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Sep 06 12:09:36.091231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1323/2694] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:37.104253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:37.106391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:37.112806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:37.113290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:37.113760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:37.114449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:37.114906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:37.115332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:37.145927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-673d712f-fda5-4fe2-916e-ebf112467615 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Sep 06 12:09:37.146503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1372/2695] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:38.159454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:38.161597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:38.168023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:38.168502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:38.168943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:38.169626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:38.170101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:38.170524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:38.201550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f511654c-ed67-4315-bf60-103001a46d08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Sep 06 12:09:38.202144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1324/2696] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:39.213842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:39.216000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:39.218324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:39.223674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:39.224164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:39.224604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:39.225296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:39.225781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:39.226211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:39.256533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0ffe1325-d6ea-472a-a9cf-80bfa639e04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Sep 06 12:09:39.257155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1373/2697] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:40.270040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:40.272333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:40.279012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:40.279501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:40.279939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:40.280639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:40.281096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:40.281524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:40.284876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=90 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:40.315382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-94a5c5be-cf7b-4c2e-8066-ef7783143c77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050600 Sep 06 12:09:40.315950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1325/2698] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:41.327245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:41.330172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:41.336613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:41.337089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:41.337528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:41.338251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:41.338712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:41.339141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:41.368528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e44baddc-cc50-41d3-88e1-ce65b40578e0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Sep 06 12:09:41.369085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1374/2699] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:42.380441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:42.382658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:42.385013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=30 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:42.390342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:42.390826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:42.391900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:42.392724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:42.393180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:42.393606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:42.425522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d32f03df-5766-46bc-919a-87f1800bf168 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049118 Sep 06 12:09:42.426116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1326/2700] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:43.437835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:43.440595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:43.447079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:43.447568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:43.448019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:43.448706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:43.449165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:43.449593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:43.479141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24ae9dd5-d457-4391-8a02-c04c2f4d5d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Sep 06 12:09:43.479707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1375/2701] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:44.491387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:44.493537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:44.499866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:44.500347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:44.501281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:44.502155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:44.502608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:44.503030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:44.533350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-901e0d58-86a3-40ad-bd20-e2abd683a3eb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Sep 06 12:09:44.533939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1327/2702] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:45.545992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:45.548236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:45.554798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:45.555268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:45.555706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:45.556393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:45.556883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:45.557574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:45.588039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-42e2b9b7-f661-41af-80b2-72aedf6e3c5b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Sep 06 12:09:45.588608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1376/2703] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:46.601283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:46.603343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:46.609857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:46.610339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:46.611385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:46.612068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:46.612522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:46.612942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:46.641959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3e1b632c-0365-4445-acee-537f98aa3a7a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Sep 06 12:09:46.642532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1328/2704] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:47.654309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:47.656362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:47.663946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:47.664430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:47.664866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:47.665557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:47.666036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:47.666461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:47.695803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f88d61b-dc88-432c-ba48-6a127518664a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Sep 06 12:09:47.696364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1377/2705] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:48.708914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:48.711137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:48.717548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:48.718069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:48.718512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:48.719202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:48.719662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:48.720667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:48.749195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-88d6f99d-6df0-41e0-9a47-a9148316e587 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Sep 06 12:09:48.749788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1329/2706] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:49.762509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:49.764539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:49.771135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:49.771610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:49.772053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:49.772723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:49.773166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:49.773581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:49.803905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9db15fbf-84e3-47b7-88fc-234b501b3559 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Sep 06 12:09:49.804453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1378/2707] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:50.817264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:50.819500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:50.826075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:50.826566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:50.827010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:50.827703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:50.828166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:50.828598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:50.857884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a30678f-56c9-417e-bacd-ff6de094aff6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Sep 06 12:09:50.858447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1330/2708] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:51.871172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:51.873238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:51.880414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:51.880940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:51.881371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:51.882096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:51.882546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:51.882966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:51.912401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e4b49bfa-e000-4f90-a789-0da38cddcfa1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 06 12:09:51.912958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1379/2709] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:52.925299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:52.927514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:52.934074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:52.934539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:52.934972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:52.935654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:52.936105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:52.936526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:52.967202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02e2b550-1549-4da1-9651-472107ebeeaa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Sep 06 12:09:52.967771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1331/2710] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:53.980455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:53.982652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:53.990464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:53.990947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:53.991375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:53.992055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:53.992505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:53.993276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:53.995648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=90 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:54.025076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6282024b-4222-43fd-8f4c-032fe706bfc1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048156 Sep 06 12:09:54.025543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1380/2711] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:55.038627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:55.040804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:55.047359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.047777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.049167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.049550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:55.050027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:55.050446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:55.224980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2880dc34-6217-4470-aec5-7ba5689847e1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190309 Sep 06 12:09:55.225538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1332/2712] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:56.237530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:56.240339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:56.247006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:56.247498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:56.247978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:56.248666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:56.249123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:56.249602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:56.282444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-43ec9c18-216d-4b78-9af5-b2b0ef5ff40b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048845 Sep 06 12:09:56.283021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1381/2713] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:56.949871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:56.950474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:56.957026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:56.957548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:56.958010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:56.958698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:56.959142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:56.959558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:56.985207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:09:57.063994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4733f699-6b1f-4a69-bb9c-2c3ee9448e60 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 204 len: 0 microversion: 2.1 time: 0.117678 Sep 06 12:09:57.064626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1333/2714] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:09:56 2022] DELETE /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:09:57.073283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:57.073923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:57.079784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:57.080267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:57.080703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:57.081391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:57.081876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:57.082453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:57.295119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:57.297399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:57.304951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:57.305488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:57.305963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:57.306676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:57.307133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:57.307565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:57.339390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:57.341627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4bb643b1-f79d-48fc-bf21-0b15711f1474 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050869 Sep 06 12:09:57.346334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1334/2715] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:09:57.349550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9a624b36-af42-4b1d-bdbf-569df64a7c7f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.280392 Sep 06 12:09:57.350170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1382/2716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:57 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:09:58.354472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:58.356669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:58.364005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:58.364499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:58.364937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:58.365632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:58.366113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:58.368482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:58.399703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d840b3db-7003-47ed-8024-d8a6f8fa29a2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049241 Sep 06 12:09:58.401016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1335/2717] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:58.501938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:58.502438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:58.508828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:58.509320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:58.509795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:58.510488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:58.510948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:58.511374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:58.646892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:58.655456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b6933bbf-88b8-4dae-b39b-9f45d8ac24c6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.286052 Sep 06 12:09:58.656022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1383/2718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:58 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:09:59.412505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:59.414672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:59.421000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:59.421514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:59.421986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:59.422680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:59.423139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:59.423797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:59.454385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c7c74b3-2226-439a-a29a-26b16c4fa40c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Sep 06 12:09:59.454951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1336/2719] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:09:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:09:59.680233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:09:59.680835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:09:59.687122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:59.687607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:59.688044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:59.688736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:09:59.689189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:09:59.689618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:09:59.820615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:09:59.828962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c28a735-8230-45cd-b180-7333ee2aa617 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153298 Sep 06 12:09:59.829535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1384/2720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:09:59 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:00.467309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:00.469425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:00.476508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:00.476990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:00.477422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:00.478137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:00.478582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:00.479002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:00.512495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-54b449bd-b7fb-4fdf-8199-9c84861bfff8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049139 Sep 06 12:10:00.513066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1337/2721] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:00.852502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:00.853073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:00.859629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:00.860114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:00.860554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:00.861245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:00.861736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:00.862169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:00.997992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:01.006725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b19d160c-a7b6-4c39-a5cd-ddc41ebacf8a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158400 Sep 06 12:10:01.007288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1385/2722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:00 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:01.525787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:01.527999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:01.534381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:01.534869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:01.535796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:01.536481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:01.536940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:01.537370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:01.567926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c042c1a7-326d-4afb-b2cd-de531c7f1023 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Sep 06 12:10:01.568505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1338/2723] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:02.030565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:02.031224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:02.038528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:02.039014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:02.039451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:02.040147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:02.040599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:02.041027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:02.170909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:02.179275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3cc2a73b-19bd-43f3-a74a-8bb83e2e75ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152511 Sep 06 12:10:02.179852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1386/2724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:02 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:02.580469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:02.582747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:02.589220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:02.589747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:02.590193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:02.590886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:02.591344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:02.591773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:02.621706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c92c06c9-a72e-426d-a148-707888ae6a8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Sep 06 12:10:02.622281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1339/2725] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:03.202856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:03.203502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:03.210407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:03.210896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:03.211336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:03.212033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:03.212492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:03.212915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:03.345563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:03.354581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f161efbf-d8f4-45f6-8df4-a9e1a692203e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155504 Sep 06 12:10:03.355160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1387/2726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:03 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:03.635082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:03.637158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:03.643779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:03.644267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:03.645278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:03.646012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:03.646472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:03.646902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:03.649522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:03.680595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b63c709-a0ad-4124-93de-4bacc7302463 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049688 Sep 06 12:10:03.681159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1340/2727] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:04.384151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:04.384807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:04.391574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:04.392056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:04.392489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:04.393350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:04.394184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:04.394584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:04.529682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:04.538498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-981f4b18-3449-45a6-aeef-cdc030eacd11 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158961 Sep 06 12:10:04.539078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1388/2728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:04 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:04.693462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:04.695667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:04.702068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:04.702551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:04.702994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:04.703679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:04.704131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:04.704556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:04.734142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74468cff-59a1-4dca-87bc-e20c79f316d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Sep 06 12:10:04.734719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1341/2729] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:05.562604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:05.563220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:05.570443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:05.570926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:05.571356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:05.572035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:05.572483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:05.572900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:05.701317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:05.709909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fedaad9b-b6d3-475f-8ebe-d77a462048bf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151103 Sep 06 12:10:05.710494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1389/2730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:05 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:05.747404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:05.749668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:05.756688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:05.757205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:05.757638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:05.758450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:05.758970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:05.759411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:05.793720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c987f8e-b4b0-4e47-8c20-351005b17dcf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050200 Sep 06 12:10:05.794292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1342/2731] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:06.733316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:06.733918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:06.740477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:06.740965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:06.741412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:06.742139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:06.742601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:06.743035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:06.807649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:06.809957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:06.817027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:06.817795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:06.817949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:06.818653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:06.819116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:06.819536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:06.850623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-33426d6f-a987-487a-b414-782861cf2cb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047531 Sep 06 12:10:06.855319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1343/2732] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:06.877698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:06.887244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c8704b67-c0e5-4302-bc41-4e30dd86d2d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157854 Sep 06 12:10:06.887828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1390/2733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:06 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:07.862835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:07.865123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:07.871774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:07.872252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:07.872683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:07.873358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:07.873912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:07.874334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:07.904405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc721a4a-3a90-4bcc-a106-9b10af5b3fab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Sep 06 12:10:07.904990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1344/2734] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:07.912319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:07.912954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:07.919504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:07.919994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:07.920437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:07.921139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:07.921604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:07.922064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:08.050683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:08.058948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0fb88a67-479a-4e9f-9502-6b2b890fd9f2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151040 Sep 06 12:10:08.059555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1391/2735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:07 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:08.917822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:08.919995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:08.927143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:08.927624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:08.928056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:08.928737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:08.929187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:08.929608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:08.959289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15cd2dc8-6dfb-419c-b917-73f593a75488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Sep 06 12:10:08.959859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1345/2736] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:09.082965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:09.083584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:09.090048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:09.090528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:09.090966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:09.091657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:09.092116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:09.092540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:09.225837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:09.233897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1366c8be-360b-4fcb-96b1-679d1284e117 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155186 Sep 06 12:10:09.234464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1392/2737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:09 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:09.972056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:09.974193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:09.980819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:09.981310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:09.981790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:09.982494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:09.982975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:09.983404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:10.017065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-032e588c-cd86-4b98-8482-17ad8a6f29b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049000 Sep 06 12:10:10.017743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1346/2738] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:10.259359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:10.260020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:10.262540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=40 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:10.267987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:10.268484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:10.268929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:10.269982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:10.270457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:10.270896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:10.407737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:10.416669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6d0d9b2c-17e7-4c2e-8fe8-21624360eafe tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161218 Sep 06 12:10:10.417250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1393/2739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:10 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:11.031524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:11.033799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:11.040230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:11.040704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:11.041143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:11.041867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:11.042316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:11.042735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:11.075098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-337208d7-897a-404b-8f69-bb916d60f1b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047724 Sep 06 12:10:11.075669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1347/2740] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:11.440483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:11.441117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:11.448263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:11.448773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:11.449165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:11.449895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:11.450371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:11.450858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:11.585656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:11.593931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d910ef01-8ac8-4b99-9084-b5454eb153b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157416 Sep 06 12:10:11.594506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1394/2741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:11 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:12.088801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:12.090918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:12.097334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:12.098396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:12.098836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:12.099529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:12.099982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:12.101831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:12.132315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-329d1cf6-3507-4d36-af90-71cc261bc1e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047497 Sep 06 12:10:12.132892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1348/2742] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:12.618565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:12.619197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:12.625475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:12.625994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:12.626423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:12.627123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:12.627610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:12.628026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:12.765560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:12.774550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34faddbc-10af-4268-b0e6-7d33cb5ab918 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159729 Sep 06 12:10:12.775403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1395/2743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:12 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:13.145520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:13.147612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:13.150286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:13.155718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:13.156207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:13.156653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:13.157354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:13.157851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:13.158279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:13.189826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5c2cce36-1e69-4ff9-96bb-ab7602da6243 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048817 Sep 06 12:10:13.190407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1349/2744] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:13.806771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:13.807384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:13.813703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:13.814574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:13.814848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:13.815583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:13.816727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:13.817763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:13.954447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:13.963195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:13.966347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6d6fa0a-edd4-4700-92d6-f569e5be3267 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.163371 Sep 06 12:10:13.966994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1396/2745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:13 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:14.203135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:14.205448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:14.212600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:14.213084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:14.213523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:14.214268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:14.214722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:14.215148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:14.244468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f480737-1d1e-4932-b412-0415f582716c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Sep 06 12:10:14.245038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1350/2746] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:14.991569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:14.992195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:14.999444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:14.999936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:15.000375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:15.001141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:15.001541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:15.002001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:15.136830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:15.145081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9fd92d34-74e7-4f48-b252-2575dbdf7683 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158182 Sep 06 12:10:15.145664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1397/2747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:14 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:15.256700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:15.258943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:15.265443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:15.265975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:15.266422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:15.267122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:15.267582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:15.268012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:15.300644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ffc8135f-afa3-4e50-a147-e257e0772115 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047725 Sep 06 12:10:15.300974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1351/2748] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:16.169137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:16.169786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:16.176362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:16.176848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:16.177290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:16.178022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:16.178485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:16.178923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:16.311430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:16.313396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:16.315610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:16.320289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-532185ba-2409-4cf5-9657-ce3b8431863e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155003 Sep 06 12:10:16.320874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1398/2749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:16 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:16.322280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:16.322846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:16.323294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:16.323998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:16.324642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:16.325366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:16.357119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e68ed8ad-ba9f-4c71-8220-fdacc3903940 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Sep 06 12:10:16.357720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1352/2750] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:10:17.343813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:17.344375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:17.351964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:17.352448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:17.352890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:17.353575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:17.354058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:17.354489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:17.370286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:17.372511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:17.379738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:17.380236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:17.380677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:17.381378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:17.381870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:17.382296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:17.414261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34d7bef8-0435-4082-ba41-3bbb54586677 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047876 Sep 06 12:10:17.414835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1353/2751] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:10:17.490532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:17.499686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a62788ed-d9b5-4928-a4a1-c3242c262558 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159610 Sep 06 12:10:17.500430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1399/2752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:17 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:18.426959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:18.429083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:18.435566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:18.436041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:18.436476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:18.437150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:18.437629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:18.438073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:18.468682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-273bf9bd-d820-47fd-b398-e4e121c730cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Sep 06 12:10:18.469240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1354/2753] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:18.522906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:18.523526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:18.530218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:18.530724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:18.531546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:18.531861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:18.532318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:18.532751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:18.666572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:18.677034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-75daa4b7-edd7-472d-a2e2-85cab017d18e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158427 Sep 06 12:10:18.677550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1400/2754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:18 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:19.481918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:19.484047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:19.491061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:19.491556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:19.492000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:19.492691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:19.493146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:19.493603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:19.523199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-19130780-d090-4104-8574-5a8b9d7e37e3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045395 Sep 06 12:10:19.523759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1355/2755] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:19.701058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:19.701688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:19.709406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:19.710174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:19.710888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:19.711926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:19.712622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:19.713266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:19.856344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:19.865800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24942292-f333-4684-af4e-29d5dba8f58d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168469 Sep 06 12:10:19.866392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1401/2756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:19 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:20.536640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:20.539146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:20.545563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:20.546078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:20.546553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:20.547234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:20.547689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:20.548112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:20.572803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:20.577938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a14105cb-9015-41fa-b67c-81ee893d9603 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Sep 06 12:10:20.578498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1356/2757] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:20.890097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:20.890685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:20.898522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:20.898983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:20.899412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:20.900350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:20.900799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:20.901215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:21.277853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:21.286058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-04d7f641-d615-4163-9c75-e9850828571a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.399871 Sep 06 12:10:21.286623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1402/2758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:20 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:21.590937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:21.593110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:21.600065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:21.600541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:21.600979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:21.601681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:21.602146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:21.602573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:21.633336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c8a4e857-dd7f-4100-a578-eadb1e5fa6bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046545 Sep 06 12:10:21.633927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1357/2759] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:22.310237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:22.310949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:22.317600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:22.318132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:22.318568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:22.319293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:22.319753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:22.320181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:22.459440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:22.467672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-656ff131-6f7e-47f4-bb95-cf906a498c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161372 Sep 06 12:10:22.468281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1403/2760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:22 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:22.646284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:22.648428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:22.655197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:22.655679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:22.656116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:22.656809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:22.657265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:22.657719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:22.687535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e306d74f-232a-4f76-b82c-be7f72010931 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045507 Sep 06 12:10:22.688097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1358/2761] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:23.495090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:23.495090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:23.500975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:23.501470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:23.501954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:23.502661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:23.503116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:23.504057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:23.646094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:23.654938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f1df468-85a0-4049-a64a-e7360bfc4f87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165424 Sep 06 12:10:23.655520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1404/2762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:23 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:23.700026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:23.702727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:23.710153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:23.710637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:23.711077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:23.711799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:23.712256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:23.712676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:23.744389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-007cc838-c32f-4257-a611-c78b3382e834 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048333 Sep 06 12:10:23.744954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1359/2763] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:24.678880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:24.679500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:24.685959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:24.686450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:24.686890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:24.687576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:24.688035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:24.688461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:24.757063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:24.759242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:24.765915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:24.766070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:24.766452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:24.767142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:24.767590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:24.768008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:24.799831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-480717ff-882f-43cc-be76-44f44558d112 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047261 Sep 06 12:10:24.800720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1360/2764] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:10:24.819320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:24.827681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3518cc35-3cd1-4fb0-96a7-a83ffc853528 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152742 Sep 06 12:10:24.828261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1405/2765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:25.812616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:25.814833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:25.821842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.822329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.822765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.823472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.823923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.824348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.852707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:25.853323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:25.858381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-143ede4c-817b-489b-9f74-c063153cc5de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049762 Sep 06 12:10:25.858969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1361/2766] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:25.859633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.860121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.860554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:25.861245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:25.861790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:25.862213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:26.000407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:26.008751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c6aea606-613e-418f-840b-925c318b64b0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159844 Sep 06 12:10:26.009323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1406/2767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:25 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:26.871101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:26.873160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:26.880536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:26.881016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:26.881452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:26.882160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:26.882611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:26.883028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:26.913921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-097c9069-d30d-4aad-ae54-562ba6760306 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Sep 06 12:10:26.914496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1362/2768] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:27.032523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:27.033148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:27.040046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.040532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.040968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.041678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.042135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.042588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.177698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:27.186103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6ed2b046-ba30-49fb-abb4-e3e840ff4988 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157496 Sep 06 12:10:27.186685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1407/2769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:27 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:27.928618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:27.930828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:27.937533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.938055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.938493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.939186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:27.939635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:27.940056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:27.970418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-40d943b8-901e-428f-81ca-4fac9f52cff7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Sep 06 12:10:27.970897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1363/2770] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:28.210883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:28.211668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:28.218991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.219711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.220389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:28.221509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.222887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.223563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:28.368751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:28.377146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9d5f0c9c-91ba-4482-8679-60417bb041bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170913 Sep 06 12:10:28.377748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1408/2771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:28.983680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:28.985977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:28.993183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.993705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.994154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:28.994858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:28.995312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:28.995747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:29.027579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f76d0465-c639-4ee3-8b4d-cf7bded01d5a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047713 Sep 06 12:10:29.028080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1364/2772] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:29.402578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:29.403153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:29.410737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:29.411255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:29.411726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:29.412454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:29.412942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:29.413401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:29.545857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:29.554888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-224500af-1af4-46a9-9f66-50a4f5c584fb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156581 Sep 06 12:10:29.555618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1409/2773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:29 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:30.040523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:30.042676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:30.049205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:30.049726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:30.050239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:30.050939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:30.051404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:30.051836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:30.082669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7632eb32-becd-4d03-9f08-d18398a3a42e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Sep 06 12:10:30.083232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1365/2774] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:30.578316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:30.579131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:30.586605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:30.587417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:30.588135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:30.589349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:30.590145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:30.590855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:30.728951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:30.737164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-72175e21-c4a9-4553-92a2-a59e8c7ef036 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162836 Sep 06 12:10:30.738376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1410/2775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:31.095368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:31.098178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:31.104583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:31.105069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:31.105508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:31.106233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:31.106693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:31.107123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:31.136408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62d9bf25-b5bc-4d77-a9ad-e148e441e2ee tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Sep 06 12:10:31.136889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1366/2776] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:31.761571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:31.762788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:31.772462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:31.772956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:31.773395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:31.774275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:31.774863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:31.775652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:31.931051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:31.942557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2f5aa64d-c13f-4bcd-8752-8457ea32e069 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.184961 Sep 06 12:10:31.943806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1411/2777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:31 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:32.149361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:32.151745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:32.158635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:32.159117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:32.160140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:32.160834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:32.161282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:32.161880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:32.200998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31f336d7-c49e-4322-9069-6cb62e4d2951 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055846 Sep 06 12:10:32.201575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1367/2778] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:32.966442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:32.967037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:32.974091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:32.974576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:32.975011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:32.975742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:32.976189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:32.976610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:33.116452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:33.124667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0fa74ab9-e93f-44d2-a55d-503da984c6c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162054 Sep 06 12:10:33.125295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1412/2779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:32 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:33.214172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:33.216338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:33.223179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:33.223668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:33.224112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:33.224876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:33.225262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:33.225740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:33.256040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-626cc010-2d9f-4023-bbbc-0692db5c96a7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Sep 06 12:10:33.256614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1368/2780] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:34.149818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:34.150672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:34.156878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:34.157634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:34.158094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:34.158799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:34.159259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:34.160378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:34.189420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:34.272736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:34.275856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:34.282636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:34.283134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:34.283573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:34.284461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:34.285707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:34.286148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:34.318150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2dae4f44-2f72-4a72-b2d1-73c2028d31dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050212 Sep 06 12:10:34.319035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1369/2781] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:10:34.319629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:34.329682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ac55c2e5-5737-4d88-8b76-e9c51c2083ef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.184514 Sep 06 12:10:34.330204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1413/2782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:35.329927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:35.333098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:35.339675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:35.340155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:35.340595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:35.341299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:35.341784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:35.342210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:35.355751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:35.356470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:35.358752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:10:35.359230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 (ip 10.222.0.18) !!! Sep 06 12:10:35.361285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:10:35.361438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 (ip 10.222.0.18) !!! Sep 06 12:10:35.377497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f4acbdb8-c5fe-4734-9371-0f611a99a9b0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051508 Sep 06 12:10:35.378119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1370/2783] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:10:35.381842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:35.382371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:35.382971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:35.383584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:35.384083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:35.384642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:35.541037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:35.549134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf07624f-7ca4-4a34-b077-0e3121d8623b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.198631 Sep 06 12:10:35.549752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1414/2784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:35 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:36.390948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:36.393105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:36.400587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:36.401080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:36.401528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:36.402271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:36.402731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:36.403166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:36.435025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1392cce9-4330-4100-a719-2dfc85ab23d0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 Sep 06 12:10:36.435592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1371/2785] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:36.573580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:36.574240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:36.580676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:36.581165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:36.582284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:36.582999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:36.583460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:36.583891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:36.716527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:36.725556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6eeb311-d611-4948-a711-ce40272162ac tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156492 Sep 06 12:10:36.726201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1415/2786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:36 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:37.447507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:37.449696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:37.456321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:37.456854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:37.457300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:37.458037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:37.458492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:37.458924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:37.493123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-223b4d64-e0f0-426a-ab34-4bd8445c00f0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048642 Sep 06 12:10:37.493123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1372/2787] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:37.749755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:37.750353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:37.757053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:37.757538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:37.758005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:37.758720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:37.759176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:37.759604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:37.897569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:37.906319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cf5cb832-5e1f-4c57-8a17-a1eff0a0af9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160603 Sep 06 12:10:37.906879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1416/2788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:37 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:38.650601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:38.652792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:38.658773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:38.659258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:38.659697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:38.660701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:38.661161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:38.661589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:38.676497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:38.693494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3d130e55-879f-4a68-aacc-5055bd3a1de8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192826 Sep 06 12:10:38.694005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1373/2789] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:38.931160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:38.931904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:38.939607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:38.940108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:38.940564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:38.941623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:38.942298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:38.942730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:39.082310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:39.091643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6225283f-ffe7-4516-a00c-8e4c2ad15764 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.164412 Sep 06 12:10:39.092229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1417/2790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:39.707901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:39.710131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:39.716436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:39.716854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:39.717291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:39.718019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:39.718475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:39.718903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:39.749099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eeb978e9-1489-410a-a513-4de82c3024c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 Sep 06 12:10:39.749696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1374/2791] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:40.116720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:40.117418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:40.124263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:40.124892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:40.125338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:40.126079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:40.126545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:40.126978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:40.267039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:40.276973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-262c32b6-b212-4247-a6d8-b53219c2eff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.164383 Sep 06 12:10:40.277566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1418/2792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:40 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:40.762279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:40.764473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:40.766468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:10:40.766637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:10:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:10:40.774960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:40.775695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:40.776130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:40.776862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:40.777311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:40.777884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:40.809767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d36b4efc-d9c3-4833-88d3-86127ec07c62 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051376 Sep 06 12:10:40.810335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1375/2793] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:41.302247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:41.302925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:41.305207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=52 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:41.310695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:41.311176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:41.311610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:41.312299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:41.312757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:41.313172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:41.450926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:41.459893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2d093758-c491-43e1-a012-ff582301b00f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162702 Sep 06 12:10:41.460523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1419/2794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:41 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:41.823050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:41.825253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:41.832294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:41.832827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:41.833278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:41.833992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:41.834444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:41.834875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:41.865178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6855fe9d-f7f7-4e0d-a0ff-4bc5b51198ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Sep 06 12:10:41.865768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1376/2795] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:10:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:10:42.483668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:42.484719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:42.491461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:42.491942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:42.492378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:42.493096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:42.493544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:42.493993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:42.629758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:42.637953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-113f8373-a6cf-4d3d-8b70-67d114ac1bf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158686 Sep 06 12:10:42.638546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1420/2796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:42 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:42.877185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:10:42.879998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:42.886572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:42.887065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:42.887509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:42.888305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:42.888890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:42.889388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:43.007286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22020e47-e694-49da-aac6-8b0837e2e97e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action" status: 200 len: 76017 microversion: 2.1 time: 0.133658 Sep 06 12:10:43.007894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1377/2797] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 12:10:42 2022] POST /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3/action => generated 76017 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:10:43.663163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:43.663771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:43.670309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:43.670796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:43.671236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:43.671935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:43.672389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:43.672813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:43.809338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:43.817916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-03f960e7-2310-4071-a646-b2192115b2f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159336 Sep 06 12:10:43.818497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1421/2798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:43 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:44.842516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:44.843139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:44.845626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=58 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:44.851678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:44.852173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:44.852615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:44.853313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:44.853819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:44.854251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:45.051169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:45.059705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-531077f8-ed61-4bf9-a873-b2fdbcc67106 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.221544 Sep 06 12:10:45.060499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1378/2799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:44 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:46.085793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:46.086417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:46.093228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:46.093766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:46.094219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:46.094944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:46.095445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:46.095989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:46.235298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:46.244304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-423d8a12-a728-497b-8667-66f7954eb008 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162769 Sep 06 12:10:46.245838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1422/2800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:46 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:47.268659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:47.270296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:47.276924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:47.277628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:47.278083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:47.278786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:47.279237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:47.279660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:47.424150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:47.433373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e791d5d3-33b2-4680-99c8-5de0986e2b9d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168614 Sep 06 12:10:47.433997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1379/2801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:47 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:48.458409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:48.459012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:48.465432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:48.465945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:48.466383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:48.467101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:48.467559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:48.467980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:48.629874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:48.641767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8aec45f1-e098-4cd0-b119-94eee67c3d35 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.186711 Sep 06 12:10:48.642046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1423/2802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:48 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:49.669350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:49.670332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:49.678294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:49.678781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:49.679220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:49.679927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:49.680390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:49.680808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:49.820862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:49.829269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8cfa50df-d937-4d9a-af37-039938bd7174 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165907 Sep 06 12:10:49.829891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1380/2803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:49 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:50.854597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:50.855181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:50.862237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:50.863399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:50.863820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:50.864589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:50.865106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:50.865585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:51.009783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:51.019082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a872d8e6-c8a7-4d96-8133-c4750629da34 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168424 Sep 06 12:10:51.019682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1424/2804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:50 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:52.043183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:52.043800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:52.051946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:52.052484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:52.053150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:52.053880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:52.055977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:52.056452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:52.194841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:52.203437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-207a01ab-5ee9-403c-9912-73e260428cf1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.164110 Sep 06 12:10:52.204016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1381/2805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:52 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:53.227526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:53.228162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:53.234718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:53.235213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:53.235649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:53.236346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:53.236804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:53.237227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:53.392505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:53.401880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-70314d24-7c4c-4d88-8483-63276de6f78a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.178627 Sep 06 12:10:53.402482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1425/2806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:53 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:54.426768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:54.427419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:54.433999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:54.434650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:54.435017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:54.435721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:54.436206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:54.436629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:54.612751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:54.622041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d46faa92-6b22-4391-b462-6fc654c5f1d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.199835 Sep 06 12:10:54.622634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1382/2807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:54 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:55.646802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:55.647399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:55.649390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:10:55.649540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:10:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 (ip 10.222.0.18) !!! Sep 06 12:10:55.657885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:55.658378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:55.658818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:55.659524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:55.659983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:55.660412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:55.805684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:55.814236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-977899a4-c287-486c-aa12-f73a934245b6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.172085 Sep 06 12:10:55.814823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1426/2808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:55 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:56.841705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:56.842558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:56.852540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:56.853030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:56.853462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:56.854180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:56.854636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:56.855051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:57.037158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:57.047827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-06d10bf7-cb54-48ac-9439-0621dc591060 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.210111 Sep 06 12:10:57.048666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1383/2809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:56 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:10:58.072105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:58.072948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:58.079451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:58.079941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:58.080380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:58.081094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:58.081555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:58.082538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:58.216780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:58.226156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21bf2eb9-fd0e-4352-b11b-36c27c39970c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157986 Sep 06 12:10:58.226740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1427/2810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:58 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:10:59.250328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:10:59.250983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:10:59.257588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:59.258097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:59.258530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:59.259218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:10:59.259670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:10:59.260094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:10:59.391349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:10:59.399894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1723a5a-dd34-4fdd-a2ea-2908676751af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153681 Sep 06 12:10:59.400739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1384/2811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:10:59 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:00.424335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:00.424977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:00.432199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:00.432692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:00.433128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:00.433869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:00.434326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:00.434752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:00.584200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:00.592750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bcaba11b-7d06-4a20-ab45-39d8c8e20a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.172264 Sep 06 12:11:00.593334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1428/2812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:00 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:01.617073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:01.617799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:01.624132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:01.624610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:01.625041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:01.625750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:01.626202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:01.626623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:01.764150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:01.772328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9820521-2d4e-4fd1-bd35-5f5ef9ac75fc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159180 Sep 06 12:11:01.772895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1385/2813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:01 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:02.795659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:02.796251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:02.803207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:02.803691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:02.804128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:02.804827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:02.805289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:02.805740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:02.967246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:02.975998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-51472be9-19e1-426a-93d1-a7477c049f48 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.184050 Sep 06 12:11:02.976580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1429/2814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:02 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:04.000193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:04.000822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:04.007523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:04.008014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:04.008454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:04.009183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:04.009670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:04.010155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:04.141845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:04.151423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ff72b55f-1c08-48c7-a44a-76ae5f0d86ab tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154673 Sep 06 12:11:04.151670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1386/2815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:03 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:05.175510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:05.176825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:05.183267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:05.183749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:05.184193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:05.184881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:05.185346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:05.185803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:05.188382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:05.322794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:05.331006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9fc2647d-7212-42a2-bcc6-a1c60ff44138 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159404 Sep 06 12:11:05.331573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1430/2816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:05 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:06.354572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:06.355186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:06.361677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:06.362281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:06.362623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:06.364197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:06.364661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:06.365475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:06.504789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:06.515984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a4af2a4-d3d1-4e8e-89d2-328b87eafa55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165118 Sep 06 12:11:06.516747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1387/2817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:06 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:07.541840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:07.542452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:07.549055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:07.549542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:07.550038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:07.551515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:07.551979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:07.552411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:07.696359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:07.705198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-33a63e71-68ec-4e4e-bcd9-b9fef0a506a2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.167359 Sep 06 12:11:07.705801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1431/2818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:07 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:08.311790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:08.312381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:08.319412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:08.319890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:08.320320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:08.321002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:08.321447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:08.322007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:08.349667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:11:08.402476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:08.432065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aff2b6df-b26d-4743-b7f5-2aeddccd2461 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 204 len: 0 microversion: 2.1 time: 0.123728 Sep 06 12:11:08.432669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1388/2819] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:11:08 2022] DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:11:08.441675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:08.442321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:08.448262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:08.448747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:08.449184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:08.449925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:08.450388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:08.450812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:08.587757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:08.596048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-22afb838-4deb-486b-b71a-31eeeaa26247 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158917 Sep 06 12:11:08.596622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1432/2820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:08.728849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:08.729584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:08.735988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:08.736481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:08.736902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:08.737593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:08.739304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:08.739754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:08.869792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:08.877912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a7f6691-b14d-4eb9-b12b-9a27a67cbac0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153288 Sep 06 12:11:08.878512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1389/2821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:08 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:09.620082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:09.620713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:09.627020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:09.627512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:09.627951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:09.628862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:09.629349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:09.629675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:09.764821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:09.773345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e807e279-5d17-468d-a256-508dc757b349 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157163 Sep 06 12:11:09.773951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1433/2822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:09.901144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:09.901787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:09.908246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:09.908729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:09.909167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:09.910393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:09.910853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:09.911375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:10.047138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:10.055647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cde7a66b-1b80-4b09-bf87-e03c88f51ce2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158545 Sep 06 12:11:10.056323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1390/2823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:09 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:10.798114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:10.798747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:10.805939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:10.806428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:10.806855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:10.807536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:10.807982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:10.808403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:10.948147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:10.963237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-647eb73e-479b-4e0b-975b-85dcea6ece45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168602 Sep 06 12:11:10.964351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1434/2824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:11.079068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:11.079697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:11.086419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:11.086907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:11.087565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:11.088045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:11.088507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:11.088936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:11.225536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:11.233725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37612301-1d8b-4b7b-8d2f-30f261261d64 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158491 Sep 06 12:11:11.234304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1391/2825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:11 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:12.004269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:12.004830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:12.008089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=32 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:12.013738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:12.014232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:12.014666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:12.015370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:12.015821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:12.016252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:12.156509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:12.165754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5751c8a1-b3e6-4fa5-9b2c-8388ce4ab010 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165434 Sep 06 12:11:12.166355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1435/2826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:12.257605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:12.258181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:12.264921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:12.265402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:12.265865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:12.266557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:12.267003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:12.267421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:12.405688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:12.415001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5f4ae135-7f5c-45dc-81d5-a64022e79496 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161417 Sep 06 12:11:12.415588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1392/2827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:12 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:13.189955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:13.190579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:13.197946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:13.198435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:13.198878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:13.199580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:13.200043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:13.200475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:13.336558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:13.344845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-473abe15-4a67-4871-be0b-4e2e0207d479 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158809 Sep 06 12:11:13.345425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1436/2828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:13.438598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:13.439211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:13.445793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:13.446224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:13.446666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:13.447396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:13.447853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:13.448283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:13.580868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:13.589150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0fb40754-2c39-460e-8506-7e5d697a9432 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154369 Sep 06 12:11:13.589747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1393/2829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:13 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:14.051302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:14.052015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:14.057789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.058433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.058882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.059571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.060031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.060458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.086816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:11:14.165085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f299892f-3c1c-4199-9f16-e2ff3aea4d2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 204 len: 0 microversion: 2.20 time: 0.117485 Sep 06 12:11:14.165663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1437/2830] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 6 12:11:14 2022] DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 12:11:14.175496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:14.176106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:14.182350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.183083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.184232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.184526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.184970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.185392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.323756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:14.332270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:14.334465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:14.335634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d0d42e4f-09df-41dd-a8c5-aa7ca0dc8407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164194 Sep 06 12:11:14.336185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1394/2831] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:14.371141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:14.371777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:14.378318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.378807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.379245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.380509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.380963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.381390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.522587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:14.531276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f207ff1-b304-4e39-8247-ea6be477999a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164420 Sep 06 12:11:14.531842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1438/2832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:14.612937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:14.613539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:14.620572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.621059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.621558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.622210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:14.622665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:14.623092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:14.760919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:14.769131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0d49442a-933b-4894-b42f-ec926906d22f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160075 Sep 06 12:11:14.769717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1395/2833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:14 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:15.362217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:15.362843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:15.368866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:15.369367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:15.369851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:15.370560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:15.371019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:15.371448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:15.510802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:15.519855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:15.521857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:15.523044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-31b07782-defd-425a-bc59-5bf4487e9aa9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164800 Sep 06 12:11:15.523611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1439/2834] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:15.554623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:15.555241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:15.557180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:15.562727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:15.563217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:15.563660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:15.564438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:15.564827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:15.565257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:15.704443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:15.713267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d87c666c-623f-448e-9612-69ead51683a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162758 Sep 06 12:11:15.713860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1396/2835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:15.792603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:15.793145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:15.799127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:15.799610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:15.800047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:15.800735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:15.801195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:15.801864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:15.936177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:15.947211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88a79684-d655-4cec-a8b8-40c196fa595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158420 Sep 06 12:11:15.947802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1440/2836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:15 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:16.549599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:16.550282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:16.556796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:16.557296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:16.557762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:16.558472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:16.558931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:16.559375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:16.696957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:16.705609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:16.707152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:16.708900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c519e999-3086-4e18-ad4f-cfa8e43a88f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163647 Sep 06 12:11:16.709465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1397/2837] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:16.735781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:16.736399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:16.742955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:16.743442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:16.743883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:16.744575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:16.745037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:16.745463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:16.881732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:16.889959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7b8e380b-03a3-4c17-8cba-018b334e4082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157953 Sep 06 12:11:16.890567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1441/2838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:16.972808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:16.973998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:16.980051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:16.980532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:16.980961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:16.981668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:16.982132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:16.982552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.117461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:17.125674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-723b7e9b-2206-490b-8ed1-209adabeba10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157039 Sep 06 12:11:17.126240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1398/2839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:16 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:17.651691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:17.652182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:17.658165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.658650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.659087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.659767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.660222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.660829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.686200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:11:17.735562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:17.736229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:17.744547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.745038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.745478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.746202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.746661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.747086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.767420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-84a1cab5-dbdd-487d-a15a-f32bae8f1649 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 204 len: 0 microversion: 2.1 time: 0.119580 Sep 06 12:11:17.768010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1442/2840] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:11:17 2022] DELETE /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:11:17.777124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:17.777861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:17.783921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.784425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.784873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.785579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.786173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.786586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.802522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:17.886811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:17.895634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:17.897097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:17.898316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-624293ae-3b99-4bcc-b7ff-f6d2c9a34562 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166773 Sep 06 12:11:17.898880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1399/2841] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:17.914422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:17.915453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:17.921567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.922125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.922768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.923479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:17.923941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:17.924367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:17.930674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:17.939107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5575b77-dd88-474b-a396-b739a82cdcc6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166434 Sep 06 12:11:17.939679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1443/2842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:18.059119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:18.067342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-42659211-5bb2-4fb7-b97f-245e32b5795b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157555 Sep 06 12:11:18.067910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1400/2843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:18.150259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:18.151133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:18.157576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:18.158103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:18.158547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:18.159256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:18.159722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:18.160151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:18.294877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:18.303341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc777ab3-9a09-47e8-981d-c507c9191c12 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156861 Sep 06 12:11:18.303868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1444/2844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:18 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:18.925053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:18.925702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:18.932343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:18.932822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:18.933271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:18.934002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:18.934596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:18.934913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:18.962218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:18.962919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:18.969324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:18.969845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:18.970276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:18.970963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:18.971413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:18.971833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:19.098684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:19.107089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:19.107571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:19.109022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:19.110264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5a8b9d96-217a-41b8-9d4b-23d3b25d4c62 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.189385 Sep 06 12:11:19.110852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1401/2845] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:19.115978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:19.116590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:19.117259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d0b587c4-8050-4bf4-9459-7fb8064a652a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159218 Sep 06 12:11:19.118105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1445/2846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:19.122669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:19.123156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:19.123601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:19.124296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:19.124755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:19.125185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:19.257250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:19.265675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-67ee3238-c41f-4b12-b631-d04275bbad5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.153816 Sep 06 12:11:19.266246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1402/2847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:19.326383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:19.326990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:19.332848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:19.333325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:19.333775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:19.334454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:19.334901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:19.335318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:19.484402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:19.493428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3bb2adca-6a3c-4074-afe3-db5ecba66c2a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170824 Sep 06 12:11:19.494058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1446/2848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:19 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:20.135710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:20.136413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:20.141324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:20.142021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:20.143069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.143573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.144010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.144708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.145199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.145790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.148800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.149286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.149751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.150762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.151222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.151646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.298055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:20.308520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:20.309102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d3d263eb-e52c-4977-aa2d-4b19cbe009c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.171515 Sep 06 12:11:20.309729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1447/2849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:20.314394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:20.315005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:20.320041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:20.322710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:20.322942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.323751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.324520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.324734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e98c5b9d-3759-4593-ad6c-1b9e5c0fecdb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.192693 Sep 06 12:11:20.325821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1403/2850] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:20.325972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.326321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.326775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.460189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:20.468455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-32766de2-b706-4c69-b8d7-904ce8ddb966 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157779 Sep 06 12:11:20.469024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1448/2851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:20.516621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:20.517332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:20.523873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.524349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.524778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.525743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:20.526202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:20.526626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:20.656839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:20.665199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dcbf7a43-fe45-4088-9aad-2e1a29a7dfca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152481 Sep 06 12:11:20.665791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1404/2852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:20 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:21.333870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:21.334512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:21.340927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.341483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.342002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.342724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.343250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.343608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.350843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:21.351586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:21.358083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.358569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.359004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.359711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.360205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.360631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.376516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:21.481390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:21.490830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-819383b8-0f56-4118-9a58-18c172a95593 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161126 Sep 06 12:11:21.491423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1449/2853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:21.495914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:21.496529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:21.500056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:21.509477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.509751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:21.509927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.510366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.511063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.511396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:21.511525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.511935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.512727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ffc10c5-1546-4165-98cc-708295e0dd68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165874 Sep 06 12:11:21.513169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1405/2854] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:21.645922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:21.654871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-43a0c9d7-dcc2-403c-9fde-36149573c9b3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162406 Sep 06 12:11:21.655471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1450/2855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:21.688298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:21.688900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:21.695355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.695830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.696258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.697058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:21.697508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:21.697962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:21.827692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:21.836357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-135cd230-78a3-4e97-b080-e685cfe13f2f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151883 Sep 06 12:11:21.836933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1406/2856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:21 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:22.514746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:22.515303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:22.523043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.523527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.523957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.524669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.525124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.525851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.538418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:22.539067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:22.545569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.546098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.546540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.547242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.547700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.548131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.663533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:22.671817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-865a0ad0-e7a9-45eb-b3f0-3b96487dccf7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160982 Sep 06 12:11:22.673969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1451/2857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:22.678774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:22.679596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:22.680588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:22.685701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.686193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.686633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.687334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.687795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.688216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.689842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:22.691342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:22.693164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a220f90c-e179-4b1c-88ce-5b282360f88a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158812 Sep 06 12:11:22.693760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1407/2858] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:22.826689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:22.835172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d38f5026-5cbf-4fec-b209-a726741b06ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160234 Sep 06 12:11:22.835744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1452/2859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:22.860791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:22.861446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:22.867899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.868379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.868814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:22.869500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:22.869985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:22.870413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.000974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:23.009821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aabe2dc1-6a2f-41e3-b722-068b83d58c3f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152847 Sep 06 12:11:23.010393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1408/2860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:22 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:23.697023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:23.697670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:23.704550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:23.705031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:23.705497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.706201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:23.706651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:23.707069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.720345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:23.720991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:23.728475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:23.728967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:23.729408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.730127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:23.730584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:23.731070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.851994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:23.862299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc818432-ce7c-4172-a406-4bc84f273b49 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169210 Sep 06 12:11:23.877867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1453/2861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:23.877867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:23.877867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:23.877867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:23.878575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:23.878575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.878575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:23.878575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:23.879002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:23.888465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:23.897502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:23.899015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:23.900184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6e83ce97-5893-4821-a404-ab0eb5722deb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.183756 Sep 06 12:11:23.901005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1409/2862] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:24.014351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:24.022572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-86c019d2-4edf-4cce-b4e7-bca3abfc193f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158738 Sep 06 12:11:24.023137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1454/2863] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:24.032102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:24.032795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:24.039458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:24.040043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:24.040477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:24.041187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:24.041675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:24.042097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:24.174331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:24.183269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8b217b49-502e-4156-88df-ca82f58981bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154766 Sep 06 12:11:24.185873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1410/2864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:24.888584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:24.889190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:24.895959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:24.896451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:24.896893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:24.897598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:24.898086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:24.898516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:24.927018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:24.928653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:24.935769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:24.936523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:24.936964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:24.937694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:24.938156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:24.938790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:25.035170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:25.044381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5970d4a7-4703-42f2-a011-3004d359cfbf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159656 Sep 06 12:11:25.044968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1455/2865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:25.049585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:25.050341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:25.056218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:25.056716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:25.057203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:25.058001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:25.058812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:25.058941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:25.075282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:25.084523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:25.085997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:25.087176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dfbd8817-d50e-48d2-ba7e-18557025c9cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164735 Sep 06 12:11:25.087739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1411/2866] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:25.194198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:25.202426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c996e06b-bbe8-40f4-830c-7df572ad36d5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156470 Sep 06 12:11:25.203104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1456/2867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:25.210764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:25.211472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:25.217663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:25.218230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:25.218737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:25.219493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:25.220047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:25.220480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:25.361220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:25.369690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-48a7fa51-f53e-483c-b722-a41463c13d72 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.163334 Sep 06 12:11:25.370544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1412/2868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:25 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:26.068858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:26.069414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:26.076157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.076642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.077085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.077806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.078268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.078696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.115163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:26.115777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:26.122369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.122860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.123303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.124015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.124477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.124905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.211902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:26.220908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f58632c-4fd3-4948-94d8-57431c301711 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156417 Sep 06 12:11:26.221499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1457/2869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:26.227989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:26.228609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:26.234864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.235358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.235803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.236504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.236963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.237925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.259204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:26.268259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:26.269977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:26.271863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e93bf67-a8cb-49c7-96ed-edf20644f9db tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161382 Sep 06 12:11:26.272499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1413/2870] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:26.373217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:26.381633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4032830e-66ab-43ba-a3dd-2fc976f90a54 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157643 Sep 06 12:11:26.382226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1458/2871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:26.393766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:26.394388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:26.400622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.401111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.401556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.402264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:26.402721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:26.403146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:26.533156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:26.542243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a8bea7c9-340c-4d89-b19a-384ccc77b967 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152370 Sep 06 12:11:26.542819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1414/2872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:26 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:27.245814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:27.246570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:27.252722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.253212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.253665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.255005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.255539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.255966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.298543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:27.299125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:27.307055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.308879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.308879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.309299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.309791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.310213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.447697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:27.456778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:27.458504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:27.459687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-204aa19c-6de2-4ff3-bd70-9da123245641 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165083 Sep 06 12:11:27.460250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1415/2873] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:27.464650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:27.465261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:27.471274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.471982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.472421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.473488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.474383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.474818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.483323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:27.493160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-730d1ea4-4e9a-4224-ac6b-9bd7eee80758 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.251405 Sep 06 12:11:27.493955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1459/2874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:27.570449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:27.571329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:27.577594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.578193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.578705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.579468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:27.580415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:27.580415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:27.584208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:27.632380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:27.641262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3ffc5116-c4c0-429a-9e52-3632fc966c0e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.179575 Sep 06 12:11:27.653674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1416/2875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:27.814237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:27.822630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f4aaa3cc-817b-486b-afef-f1d8ee71827d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.261107 Sep 06 12:11:27.823459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1460/2876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:27 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:28.485402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:28.486070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:28.493255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.493756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.494188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.494868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.495315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.495734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.516397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:28.517013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:28.524047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.524527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.524961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.526449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.527063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.527620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.628582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:28.640322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:28.640322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:28.641057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b6daeebc-5989-4af3-b522-e3dc0a5a6bdf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159608 Sep 06 12:11:28.641859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1417/2877] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:28.662625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:28.667080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:28.667690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:28.670953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-97739e4f-06c0-41d8-b851-65a2ed4c2fd5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158393 Sep 06 12:11:28.671532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1461/2878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:28.673540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.674051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.674481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.675162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.675612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.676683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.814127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:28.822517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-01bd75f7-efd0-4f96-8435-4513825146bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159164 Sep 06 12:11:28.823092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1418/2879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:28.845659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:28.846443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:28.853465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.853980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.854413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.855094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:28.855566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:28.855966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:28.989804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:28.998065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-895c69f4-0631-47d4-92ab-2bc1bf937f88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156337 Sep 06 12:11:29.003972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1462/2880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:29.667187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:29.667806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:29.674294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.674777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.675213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.676382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.676842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.677266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.695538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:29.696160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:29.702549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.703040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.703486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.704189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.704645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.705074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.811028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:29.822135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:29.823603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:29.824789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc391a4e-f69b-4737-a896-7dfe10816779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161663 Sep 06 12:11:29.825978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1419/2881] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:29.844119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:29.846162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:29.846774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:29.853346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-353c11ed-5d12-4e6f-9903-b1928f5e8d79 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162345 Sep 06 12:11:29.853887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.854036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1463/2882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:29.854381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.854822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.855523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:29.855982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:29.856410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:29.987513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:29.996309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5aaba1e3-cdef-43ff-8bd9-22bc39ea8b60 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.153855 Sep 06 12:11:29.996884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1420/2883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:30.021518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:30.022199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:30.028397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.028879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.029313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.030044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.030499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.030920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.164699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:30.174830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a661e00-a8f7-472b-aa66-fd152f30a9df tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157718 Sep 06 12:11:30.175562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1464/2884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:30.857062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:30.857715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:30.864975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.865463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.865927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.866626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.867082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.867507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.883307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:30.884635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:30.890519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.891067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.891508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:30.892216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:30.892679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:30.893107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.004992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.013789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.015234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.016409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-457c6d0f-6a1a-494a-8ff2-b739313e8d31 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163324 Sep 06 12:11:31.016980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1421/2885] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:31.021691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:31.022313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:31.028351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:31.028837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:31.030238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.031005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:31.031625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:31.031737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.032068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.036519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:31.040525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-61a4c1d1-12f1-45ec-9488-b0ae3926b405 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167957 Sep 06 12:11:31.041112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1465/2886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:31.170555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.179240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fca29453-4161-480c-bfe6-a650d2292dcb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161312 Sep 06 12:11:31.179822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1422/2887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:31.198720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:31.199340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:31.205236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:31.205759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:31.206199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.206883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:31.207514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:31.207771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:31.338205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:31.346449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d07d3fb8-0572-4880-8242-e911655e05af tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151519 Sep 06 12:11:31.347036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1466/2888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:31 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:32.043693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:32.044281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:32.050634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.051291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.051579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.052262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.052708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.053127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.064379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:32.065001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:32.071957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.072444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.072884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.073582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.074067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.074495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.193142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.202038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.203497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.204685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-be193664-e62f-4c48-9305-41c8dd81eba0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164941 Sep 06 12:11:32.205257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1423/2889] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:32.210405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:32.211018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:32.212239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.217174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.217695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.218142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.218848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.219308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.219734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.221669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d867e676-8bde-440c-8e0d-7293e76f60bb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161104 Sep 06 12:11:32.222322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1467/2890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:32.354905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.363063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-17425ed9-117e-483e-81f2-245022a23bb9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156822 Sep 06 12:11:32.364398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1424/2891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:32.369759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:32.370369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:32.376363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.376845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.377282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.377985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:32.378458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:32.378855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:32.508130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:32.516427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-07622d8b-c574-44c3-9e2a-1f9b396d1ad6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.150491 Sep 06 12:11:32.516997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1468/2892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:32 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:33.235495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:33.236078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:33.243533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.244166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.244542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:33.245000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.245752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:33.246390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.247008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.247683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.252731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.252869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.253210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.254046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.254618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.254949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.399290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:33.408599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:33.410927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:33.412397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:33.413588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2209e73c-fd4a-4609-90f2-0b5d82c350e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.182186 Sep 06 12:11:33.414377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1425/2893] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:33.418855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:33.419470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:33.421047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9aeca9a3-4fc4-4667-98d8-09c629a51966 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.179894 Sep 06 12:11:33.433705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.433705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.433705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.433705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.434281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.434281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.434943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1469/2894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:33.545761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:33.546548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:33.552800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.553405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.553891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.554630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:33.555119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:33.555547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:33.565790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:33.574775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d7d2162-a152-4633-8db2-5ab6d80a3fc8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159535 Sep 06 12:11:33.575370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1426/2895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:33.684786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:33.693496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3959c662-2d83-48c3-8bf8-0df417ceb065 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151611 Sep 06 12:11:33.694096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1470/2896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:33 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:34.445279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:34.445953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:34.451912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:34.452478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.452615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:34.452973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.453415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.454159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.454620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.455051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.459277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.459746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.460183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.460880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.461361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.461801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.593915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.603266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.604710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.605338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.605905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-777cadbb-14e0-410d-ad82-687676081d4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164800 Sep 06 12:11:34.606462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1427/2897] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:34.610790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:34.611405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:34.615751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b58b885d-ecdb-416d-a3c0-83da6ccc4f3c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167620 Sep 06 12:11:34.620863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1471/2898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:34.621024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.621024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.621024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.621024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.621518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.621518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.717712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:34.718367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:34.725202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.725724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.726169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.726869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:34.727329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:34.727837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:34.750636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.759215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0b686f4a-a0ca-4c1a-a73d-c05d8ddd9e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.151764 Sep 06 12:11:34.767681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1428/2899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:34.865343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:34.873538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c566a0c9-03cc-4c78-8201-7092c46f5b7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159798 Sep 06 12:11:34.874163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1472/2900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:35.636371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:35.637017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:35.639144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:35.639771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:35.643588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.644066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.644518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.645190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.645849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.646273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.646446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.646846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.647291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.647994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.648529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.648897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.786045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:35.786382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:35.794857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71efd3f9-2fe4-4284-8776-99052b27ec0e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159459 Sep 06 12:11:35.795072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:35.795449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1473/2901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:35.796403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:35.797583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c95ffae7-112e-45b2-aaa1-615bb5cea15b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165123 Sep 06 12:11:35.809665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1429/2902] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:35.809836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:35.809836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:35.809836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.809836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.810220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.810220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.810220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.810472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.896464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:35.897114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:35.903363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.903842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.904274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.904960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:35.905410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:35.905853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:35.945537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:35.953895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a7b6d82-a37d-4801-9bb4-c3629795434b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157387 Sep 06 12:11:35.954484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1474/2903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:36.037933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:36.046172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3520cbef-e239-47b6-a513-fea148e5f35b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153710 Sep 06 12:11:36.046767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1430/2904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:35 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:36.819831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:36.820637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:36.825881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:36.826607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:36.827248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.827790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.828240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.828963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.829450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.829947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.834661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.835149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.835574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.836269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.836750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.837170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.961783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:36.970167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:36.970739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e7f36fd5-d054-470f-8866-bcb4e73756c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155837 Sep 06 12:11:36.971576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1475/2905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:36.976128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:36.976776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:36.979627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:36.981063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:36.982266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7129933a-10c0-498d-b1cf-11ace94e7c91 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160335 Sep 06 12:11:36.982841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1431/2906] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:36.983647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.984135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.984571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:36.985268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:36.985750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:36.986373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:37.071264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:37.071809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:37.078208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:37.078697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:37.079140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:37.079839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:37.080301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:37.080729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:37.127213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:37.130652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:37.138028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-94b21914-7e2f-4eb3-a896-615d9b7248ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165536 Sep 06 12:11:37.138622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1476/2907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:37.218751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:37.227323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6cc296d0-cd2f-47a4-8bc4-fe547357f15e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160703 Sep 06 12:11:37.227896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1432/2908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:37 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:37.994368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:37.995003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:38.001546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.002097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.002528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.003226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.003690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.004116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.008661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:38.009280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:38.015723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.016224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.016648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.017344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.017832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.018263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.138965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.147948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0f71b6e-63a9-48b4-ad2c-6b113c244ea0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157740 Sep 06 12:11:38.148537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1477/2909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:38.153711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.163352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:38.163612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.164050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:38.165013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.166283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8ba19ac0-5b09-4e61-8160-85d678819023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161746 Sep 06 12:11:38.166817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1433/2910] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:38.170344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.170830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.171265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.171954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.172404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.172928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.253361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:38.254559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:38.260839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.261314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.261961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.262667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:38.263119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:38.263958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:38.308586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.318430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1f06c51a-260d-466a-90b2-843c31972048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158928 Sep 06 12:11:38.319173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1478/2911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:38.407583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:38.416640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-46593919-4fa3-4627-bd10-2999decc1d87 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168176 Sep 06 12:11:38.417232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1434/2912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:39.171265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:39.171887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:39.174250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:39.180107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.180595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.181038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.181759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.182221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.182651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.194131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:39.194724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:39.201297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.201821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.202253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.203084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.203542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.203960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.341610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.352186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.353707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.354960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1364d1f4-5b39-4dd3-9abf-70fd2fbed0a8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165097 Sep 06 12:11:39.355529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1435/2913] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:11:39.367791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:39.368409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:39.374956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.375443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.375937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.376696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.377154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.377569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.527717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.539826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a2bffef0-a4d4-4a9b-923a-db9f4811f4e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183252 Sep 06 12:11:39.540518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1436/2914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:39.545037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:39.545751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:39.553057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.553634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.554108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.554913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:39.555445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:39.555938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:39.564457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.573334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e9ec9c0-485b-4b85-b3cb-a909eef9d0c0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.405953 Sep 06 12:11:39.573942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1479/2915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:39.686373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:39.694955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c9d4e0cf-ec4c-4b3b-9374-fa25071b049a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153418 Sep 06 12:11:39.695525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1437/2916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:39 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:40.382287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:40.382893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:40.389347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.389869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.390301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.390985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.391435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.391855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.525930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.534592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.536061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.537242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99fc3ea4-b73f-4085-9eb7-5d0d86d08e7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159608 Sep 06 12:11:40.537836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1480/2917] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:40.563373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:40.563989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:40.571255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.571741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.572180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.572869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.573324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.573785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.597357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:40.598178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:40.604199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.604676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.605107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.605823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.606388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.606694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.703927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.706127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:40.714459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0e6b031-6454-4eaa-9d5c-6a015c555fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154980 Sep 06 12:11:40.715044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1438/2918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:40.719489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:40.720100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:40.725945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.726437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.726877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.727572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:40.728030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:40.728458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:40.739649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.747877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efba551e-03c6-4873-85ac-0f9d50235149 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154360 Sep 06 12:11:40.748454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1481/2919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:40.875801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:40.884866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-812394d0-ad32-4b60-85d7-ccaefb425c00 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168864 Sep 06 12:11:40.885417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1439/2920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:40 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:41.562564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:41.563204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:41.569842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.570330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.570770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.571470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.571931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.572361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.700080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:41.709306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:41.710787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:41.711971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f3cbfa71-f6fe-4fb5-9c1b-013f32f48428 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.153323 Sep 06 12:11:41.712543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1482/2921] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:41.737755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:41.738411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:41.744811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.745294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.745767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.746461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.746913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.747340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.771916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:41.772459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:41.778620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.779116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.779553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.780248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.780699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.781120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.877851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:41.886787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-916a4ada-c207-4a19-86e2-d95274b078b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152820 Sep 06 12:11:41.887743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1440/2922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:41.908337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:41.909013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:41.915795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.916290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.916728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.917424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:41.917908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:41.918343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:41.918886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:41.929247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9c8568b-21e7-4ff8-9023-0b50ec90ccd2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161814 Sep 06 12:11:41.933690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1483/2923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:42.056724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:42.064976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-315d7bdd-789f-4849-b15a-449d30bf4cc0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160509 Sep 06 12:11:42.065558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1441/2924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:41 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:42.739306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:42.739862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:42.746408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.746894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.747337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.748024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.748485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.748913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.886107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:42.895180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:42.896726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:42.897951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e08db0b-ee70-455f-8656-1f67328e1136 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163275 Sep 06 12:11:42.898521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1484/2925] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:42.911924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:42.912778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:42.919222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.919717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.920154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.920849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.921317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.921792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.952371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:42.953168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:42.960030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.960557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.961000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:42.961718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:42.962234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:42.962598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:43.063501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:43.071972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a7a21bd-fc5f-4e88-8e83-387605834ad0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164750 Sep 06 12:11:43.072759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1442/2926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:43.090971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:43.091697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:43.098367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:43.098929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:43.099588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:43.100289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:43.100748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:43.101173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:43.101877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:43.110339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fbcebf20-8703-44b0-b9ce-6a6e3cd79934 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161882 Sep 06 12:11:43.110940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1485/2927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:43.229445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:43.237803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-67aea088-ca7a-4999-9b4e-c063864216f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.150798 Sep 06 12:11:43.238414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1443/2928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:43 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:43.924419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:43.925143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:43.932583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:43.933127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:43.933589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:43.934386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:43.934906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:43.935381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.071762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:44.080503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:44.082610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:44.083786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2026ab48-6dd0-45e6-933b-ce48c42e831f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163564 Sep 06 12:11:44.084361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1486/2929] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:44.095657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:44.096277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:44.103724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.104209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.104657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.105356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.105846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.106276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.133864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:44.134509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:44.140705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.141183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.141614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.142320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.142775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.143192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.246163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:44.255178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34b7aa5d-86d8-454e-b781-5b4fd1916a91 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163353 Sep 06 12:11:44.255765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1444/2930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:44.260794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:44.261408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:44.267851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.268592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.269187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.270199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:44.270818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:44.271421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:44.285556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:44.293913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5316158f-ddd4-4240-90c1-ef5f3fc8ff40 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163784 Sep 06 12:11:44.294495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1487/2931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:44.406080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:44.414521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0111d17-be10-4305-a16c-4435d2cff872 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157607 Sep 06 12:11:44.415101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1445/2932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:44 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:45.109979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:45.110599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:45.118614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.119101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.119532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.120222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.120674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.121099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.256972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.265888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.267324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.268533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cac04cef-2ff1-490b-aff2-6d03b7f181c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162509 Sep 06 12:11:45.269095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1488/2933] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:45.283005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:45.283613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:45.286680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:45.291957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.292436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.292870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.293559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.294042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.294455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.316532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:45.317153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:45.323437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.323922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.324359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.325197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.325505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.325959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.433054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.442162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-329c626f-71c7-4b17-baa3-2675e0c59b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162453 Sep 06 12:11:45.442767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1446/2934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:45.448167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:45.448778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:45.455761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.456416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.457232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.458868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:45.459357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:45.459786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:45.460999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.469683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-42bb6f4b-eb39-45fb-910b-c40eb6aa77c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156957 Sep 06 12:11:45.470309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1489/2935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:45.593591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:45.602099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9d21f42f-e30d-4340-802c-6ddefdfc35bd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158258 Sep 06 12:11:45.602671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1447/2936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:45 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:46.295638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:46.296260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:46.303545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.304032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.304471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.305162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.305615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.306076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.436121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:46.445265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:46.446741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:46.447905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0b7afaab-a5d9-4b48-9d1d-8a280ae9c2e4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156269 Sep 06 12:11:46.448471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1490/2937] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:46.465530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:46.466244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:46.473160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.473656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.474127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.474813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.475261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.475682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.495386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:46.496081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:46.502885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.503373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.504562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.505260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.505746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.507073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.614747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:46.623699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c88ffa3-aae9-4fd6-871c-f7797c16fc9f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161916 Sep 06 12:11:46.624279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1448/2938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:46.628765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:46.629499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:46.635213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.635699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.636132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.636820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:46.637270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:46.637718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:46.648561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:46.657355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f5b0dce6-be98-420b-999b-be7d01a8d6a5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165943 Sep 06 12:11:46.658239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1491/2939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:46.994835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.003015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41dffbc9-ed9b-460d-b5df-2c60e0e2ff52 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.377798 Sep 06 12:11:47.003669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1449/2940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:46 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:47.473584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:47.474154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:47.480680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.481291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.481700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.482407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.482862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.483286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.613060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.622509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.623989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.625165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6ef993b7-c216-448f-9bd9-b9710373b472 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.155643 Sep 06 12:11:47.625745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1492/2941] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:47.647144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:47.647759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:47.654535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.655019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.655455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.656145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.656601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.657026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.680974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:47.681589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:47.687493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.687991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.688421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.689104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:47.689555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:47.689999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:47.706359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:47.791702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.800441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7bcd5b66-a451-4732-876a-55080e861c2b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157193 Sep 06 12:11:47.801031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1450/2942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:47.825476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:47.833902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-315f860b-747c-4e21-a006-cece22f6765a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157444 Sep 06 12:11:47.834488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1493/2943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:48.026741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:48.027269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:48.033121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.033600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.034063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.034742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.035189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.035610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.167777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:48.178630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3ae2a69d-48f3-443f-8bfb-f05eb7ac076f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155895 Sep 06 12:11:48.179348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1451/2944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:48 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:48.652769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:48.653309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:48.659772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.660392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.660875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.661784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.662293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.662713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.791302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:48.799927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:48.801412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:48.803186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2da644c8-2f85-443b-a624-3d49b00237ed tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.154701 Sep 06 12:11:48.803745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1494/2945] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:48.824239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:48.824855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:48.831261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.831742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.832179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.833006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.833591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.834044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.858988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:48.859606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:48.866948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.867414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.867853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.868543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:48.868986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:48.869407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:48.977417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:48.986283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9403e549-64d9-43b5-84e8-9f8f5f00b51c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165846 Sep 06 12:11:48.987072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1452/2946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:49.011714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:49.019895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-008ce515-8952-4233-b083-1c199ddebcd7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167137 Sep 06 12:11:49.021031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1495/2947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:49.203214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:49.203737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:49.209603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:49.210108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:49.210537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:49.211216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:49.211660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:49.212492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:49.349123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:49.357531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2adfec43-86f2-4fca-a023-63ccf0812d2c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158287 Sep 06 12:11:49.358155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1453/2948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:49 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:49.828846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:49.829423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:49.836347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:49.836831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:49.837266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:49.837982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:49.838443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:49.838863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:49.973192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:49.982857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:49.984297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:49.985552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-81a139fe-be37-4440-ac42-5c2c9e1f509c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160672 Sep 06 12:11:49.986066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1496/2949] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:50.009895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:50.010508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:50.016804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:50.017275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:50.017722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:50.018406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:50.019109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:50.019344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:50.046247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:50.046996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:50.053359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:50.053880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:50.054323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:50.055023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:50.055485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:50.055915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:50.159739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:50.172159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e86822e-0480-4bf5-bd42-98939871e55f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165860 Sep 06 12:11:50.173074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1454/2950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:50.195042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:50.203545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f5def1d-4044-4200-82d7-c0c1dbc2a9b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162643 Sep 06 12:11:50.204164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1497/2951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:50.384385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:50.384945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:50.390868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:50.391354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:50.391790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:50.392490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:50.392948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:50.393379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:50.409029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:50.528045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:50.536312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-67b2ce15-8cef-4be3-9ff7-295e2ae84fc2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156686 Sep 06 12:11:50.536887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1455/2952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:50 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:51.011338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:51.011956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:51.018436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.018919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.019359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.020061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.020526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.021001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.154690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:51.164781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:51.166256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:51.167426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed4f6b6e-0eb2-4d54-96c3-b5790c360f68 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160091 Sep 06 12:11:51.167990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1498/2953] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:51.206796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:51.207409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:51.214730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.215220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.215661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.216355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.216812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.217243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.227356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:51.227981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:51.234783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.235275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.235715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.236408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.236867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.237578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.350673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:51.358828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6682f7e3-c37b-428a-82b1-72adb365c72f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155775 Sep 06 12:11:51.359407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1456/2954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:51.373160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:51.382721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8c9640f7-daca-47de-981f-0921a15004aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159117 Sep 06 12:11:51.383321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1499/2955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:51.560943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:51.561484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:51.567961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.568438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.568873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.569553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:51.570152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:51.570578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:51.700666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:51.710152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-998e18e3-c7bb-43dc-be62-d8d1436e9161 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153073 Sep 06 12:11:51.710748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1457/2956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:51 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:52.194739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:52.195471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:52.201865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.202352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.202794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.203490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.203944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.204398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.339659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:52.349799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:52.351422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:52.352606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f246095f-ca15-4bd0-b966-a8d70f412af6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162556 Sep 06 12:11:52.353166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1500/2957] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:52.383075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:52.383660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:52.390573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.391061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.391503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.392194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.392672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.393085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.407033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:52.407726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:52.414149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.414630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.415058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.415742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.416187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.416603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.543158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:52.553236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-07633363-4162-4eab-905b-3fa9eac733e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.173725 Sep 06 12:11:52.554267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1458/2958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:52.558493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:52.567483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-158be74d-33d1-49fb-a79e-c6a231f3911d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163718 Sep 06 12:11:52.572120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1501/2959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:52.734353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:52.735001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:52.741089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.741580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.742040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.742727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:52.743184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:52.743612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:52.873494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:52.881734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-59e904a8-0697-4864-9a44-4bc020a3e2a9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151297 Sep 06 12:11:52.882305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1459/2960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:52 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:53.379025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:53.380271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:53.386805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.387292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.387734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.388421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.388878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.389309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.521149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:53.529979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:53.531427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:53.532586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ca4689c-25e7-4f50-a724-f4d84d33267b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157581 Sep 06 12:11:53.533155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1502/2961] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:53.576365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:53.576981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:53.583791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.584284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.584838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.585793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.586257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.586689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.591236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:53.591853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:53.597826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.598360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.598875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.599729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.600197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.600760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.725161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:53.733430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a16ff64e-6b8a-4e3c-87f1-320a19710b56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160964 Sep 06 12:11:53.734164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1460/2962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:53.737369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:53.746204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89c81524-c796-4526-8b0e-01cd24bd317d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160025 Sep 06 12:11:53.746855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1503/2963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:53.905733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:53.906328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:53.912477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.912957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.913418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:53.914133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:53.914586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:53.915008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.045922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:54.054057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-99935c33-ff8f-4a96-a4d2-1fd68688cba3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152189 Sep 06 12:11:54.054629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1461/2964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:53 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:54.558806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:54.559457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:54.566002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:54.566492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:54.566937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.568241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:54.568707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:54.569137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.702532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:54.712428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:54.714303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:54.715461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e9d5b17-c621-4e01-866e-caa82bf9a282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160802 Sep 06 12:11:54.716020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1504/2965] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:54.757369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:54.758030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:54.765573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:54.766088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:54.766552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.767249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:54.767705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:54.768134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.768895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:54.769520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:54.776661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:54.777150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:54.777591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.778747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:54.779548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:54.779981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:54.907002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:54.915829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5b95c758-7156-4168-ad72-198b3c328af0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163112 Sep 06 12:11:54.916429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1462/2966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:54.916828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:54.925224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d516d57e-538c-47dc-9d27-bd3620943096 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160424 Sep 06 12:11:54.925823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1505/2967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:55.077846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:55.078528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:55.085180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.085693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.086139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.086835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.087296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.087726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.219482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:55.228605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-18763606-9a52-4cc9-99c9-5acb374481c9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154762 Sep 06 12:11:55.229175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1463/2968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:55 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:55.742241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:55.743032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:55.750168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.750583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.751015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.751706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.752158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.752578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.887458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:55.896174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:55.897631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:55.898831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5154b666-487a-40aa-ad07-0f2c64c064f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161188 Sep 06 12:11:55.899394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1506/2969] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:55.939794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:55.940414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:55.947731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.948218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.948658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.949365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.949858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.949998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:55.950452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.950595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:55.956673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.957157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.957677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:55.958373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:55.958831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:55.959256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:56.081110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:56.090482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-274f46d5-9c16-43db-a6ff-3e9a7ab7e69f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154370 Sep 06 12:11:56.090948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1464/2970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:56.092877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:56.102397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2e41dd72-3781-487d-b0ec-376e522816a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156180 Sep 06 12:11:56.103120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1507/2971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:56.254944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:56.255639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:56.263479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:56.264204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:56.264901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:56.265874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:56.266325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:56.266744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:56.405184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:56.414175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-87d29731-f888-46b0-8008-650df9daaa61 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165302 Sep 06 12:11:56.414750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1465/2972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:56 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:56.924796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:56.925530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:56.932137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:56.932628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:56.933067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:56.933805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:56.934266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:56.934694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.069926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:57.078505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:57.079970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:57.081123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5cd044d4-ca4e-4935-aef0-ecce2c37138b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160379 Sep 06 12:11:57.081691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1508/2973] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:57.114622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:57.115245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:57.121726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:57.122163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:57.122624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.123603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:57.124063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:57.124492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.127808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:57.128462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:57.135343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:57.135826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:57.136259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.136941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:57.137389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:57.137834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.261583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:57.270416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ad95cf2-b432-4898-bffc-e0c38872b9c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159619 Sep 06 12:11:57.271223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1466/2974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:57.271838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:57.280365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c6dbc0f-bc51-4759-bd74-cfa3ab9ffd84 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156384 Sep 06 12:11:57.280929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1509/2975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:57.437073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:57.437827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:57.444706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:57.445176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:57.445608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.446318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:57.446764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:57.447183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:57.580925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:57.589294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-391a54d5-0da8-4c10-9b89-1f72c4c61372 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156001 Sep 06 12:11:57.589995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1467/2976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:57 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:58.107254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:58.107819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:58.114370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.114855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.115296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.115989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.116454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.116877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.119471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:58.250368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:58.259280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:58.260894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:58.262236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29b6042a-b078-4f34-be0f-ee3e44fd7d03 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158956 Sep 06 12:11:58.265406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1510/2977] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:58.293934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:58.294558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:58.301245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.301846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.302292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.302989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.303420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:58.303545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.303868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.304040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:58.310051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.310538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.310975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.311698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.312155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.312580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.437080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:58.445121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:58.446034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bb5d088d-9c14-49ac-85a7-b0768ade5e41 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155933 Sep 06 12:11:58.446626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1468/2978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:58.453412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-43a0a3ce-0f5a-4c91-b139-905e69c7295d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154343 Sep 06 12:11:58.454015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1511/2979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:58.614341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:58.614826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:58.620707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.621187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.621629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.622339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:58.622796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:58.623223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:58.752369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:58.761132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b49437c-1d83-4cb2-88bb-b821278fa3ad tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.150896 Sep 06 12:11:58.761722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1469/2980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:58 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:59.291509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:59.292109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:59.298634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.299116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.299552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.300245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.300706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.301161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.434812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:59.444466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:59.445944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:59.447120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-135e86dd-9a0f-437b-bb1f-b0b7ee87f7ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159613 Sep 06 12:11:59.447689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1512/2981] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:11:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:11:59.470871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:59.471512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:59.476668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:59.477272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:59.478215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.478710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.479150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.479849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.480311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.480734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.483296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.483842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.484340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.485079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.485686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.486093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.621513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:59.624148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:59.630684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d1f423b9-84ba-47fb-9d4b-ee684284f0e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157785 Sep 06 12:11:59.631453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1513/2982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:11:59.633218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00c1f6b0-6bcf-4f7a-92f2-da81463431a2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166124 Sep 06 12:11:59.633840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1470/2983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:11:59.784557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:11:59.785185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:11:59.791243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.791672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.792112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.792799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:11:59.793257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:11:59.793707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:11:59.925156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:11:59.934309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-21e1af8f-ece2-45c3-a5d8-65f70fd1938f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153649 Sep 06 12:11:59.934891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1514/2984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:11:59 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:00.472733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:00.473943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:00.480586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.481074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.481507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.482295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.482754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.483182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.609983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:00.619431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:00.620881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:00.622088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f321322b-67cf-4e08-9e2f-a9d3224a2679 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.153545 Sep 06 12:12:00.622663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1471/2985] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:00.654594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:00.655955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:00.658156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:00.658771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:00.663382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.663873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.664319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.665014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.665505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.665914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.666055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.666400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.666838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.667532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.667988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.668415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.672528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:00.798603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:00.802967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:00.807927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c2230169-c0a5-40cb-943d-1cf28c6f860f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157498 Sep 06 12:12:00.808670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1515/2986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:00.811034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7945c28e-fda7-4d9f-825d-ae2257d31b53 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156536 Sep 06 12:12:00.811544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1472/2987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:00.956874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:00.959065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:00.964311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.964795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.965237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:00.966035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:00.966498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:00.966925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.099707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:01.107967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-713b4dc3-d987-4e79-8278-909cfa368cdf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155107 Sep 06 12:12:01.108540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1516/2988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:00 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:01.649161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:01.649804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:01.656476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:01.656953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:01.657385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.658104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:01.658558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:01.658985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.791891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:01.800524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:01.802538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:01.803712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-783bc9b6-6363-4b06-83f7-20ec28aaeb57 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159039 Sep 06 12:12:01.804279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1473/2989] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:01.831917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:01.832633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:01.833714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:01.834356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:01.839151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:01.839644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:01.840118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:01.840253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.840596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:01.840845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:01.841028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.841423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:01.841729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:01.841885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.842181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:01.842600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:01.972318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:01.977712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:01.980912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-339bf4ab-813e-4902-a18a-fb97c3618c19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.150960 Sep 06 12:12:01.981499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1474/2990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:01.986837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e4d2a9e-47c9-4799-8507-e1a621ce322d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158811 Sep 06 12:12:01.987414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1517/2991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:02.132130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:02.132740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:02.138630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:02.139103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:02.139527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:02.140200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:02.140648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:02.141093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:02.273130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:02.282782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ecc3c93a-134e-40ba-92d7-98dec99eb1e7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154576 Sep 06 12:12:02.283570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1475/2992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:02 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:02.829912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:02.830530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:02.837547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:02.838177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:02.838478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:02.839164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:02.839629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:02.840057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:02.982259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:02.991082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:02.992544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:02.993760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-05793f0c-dd5a-4746-8201-14d5e60f26dc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167768 Sep 06 12:12:02.994320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1518/2993] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:03.004895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:03.005543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:03.011173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:03.012044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:03.012500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:03.012984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:03.013419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:03.014136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:03.014595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:03.015021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:03.018282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:03.018761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:03.019195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:03.020579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:03.021200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:03.021624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:03.151920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:03.159939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:03.160692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f4119b07-1b60-41ee-8c24-8dfb517efb8a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159982 Sep 06 12:12:03.162286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1476/2994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:03.168974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-06a4ea45-8976-4aa7-9449-9b114d860cef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161461 Sep 06 12:12:03.169742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1519/2995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:03.307310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:03.307964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:03.314145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:03.314637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:03.315083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:03.315803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:03.316257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:03.316837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:03.447580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:03.455729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-76f8ca0b-178a-4a1a-b789-b2970f19d7b1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152313 Sep 06 12:12:03.456310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1477/2996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:03 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:04.020997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:04.021761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:04.029434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.029958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.030415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.031118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.031580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.032009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.166084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:04.174667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:04.176619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:04.177847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa42b7f3-102b-4743-b353-ebb8c883a4e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161831 Sep 06 12:12:04.178412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1520/2997] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:04.184352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:04.184982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:04.192720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.193491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.194141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.195605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.196256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.197368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.198852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:04.199492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:04.208374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.208878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.209848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.210016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.210479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.211023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.347270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:04.350827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:04.356302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c1b1cb8-033c-4922-8fe4-ea70a811db55 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175774 Sep 06 12:12:04.356833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1478/2998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:04.359101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1df69657-f78a-40a5-9028-848ab37cf6fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165020 Sep 06 12:12:04.359661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1521/2999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:04.480486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:04.481100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:04.487023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.487504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.487939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.489412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:04.490265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:04.490695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:04.630332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:04.638593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-27022d72-1ffa-46a4-8ab1-380977fc93a3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161893 Sep 06 12:12:04.639182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1479/3000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:04 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:05.204293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:05.204907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:05.212265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.212752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.213190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.213917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.214496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.215431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.366226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:05.375001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:05.377464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:05.379096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a046f80c-f022-442f-abd4-a4ad0c98e40a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.178653 Sep 06 12:12:05.380252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1522/3001] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:05.380816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:05.381499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:05.385349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:05.385995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:05.388729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.389294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.389832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.390782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.391523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.392026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.392637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.393152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.393589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.394307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.394835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.396072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.527186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:05.531878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:05.535749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-11cb2b65-f715-48b8-980d-6262793205b5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159442 Sep 06 12:12:05.536343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1480/3002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:05.540342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e13b60d5-93fa-4495-a4a3-5be461e38186 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159114 Sep 06 12:12:05.540904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1523/3003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:05.662197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:05.662814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:05.668982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.669465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.669995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.670694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:05.671146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:05.671570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:05.804839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:05.813094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4c37081f-4b2e-4363-b988-76fb24fa8789 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154810 Sep 06 12:12:05.813573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1481/3004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:05 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:06.407278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:06.408058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:06.415629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.416109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.416540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.417221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.417699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.418233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.556031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:06.559228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:06.559844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:06.565314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:06.566138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.566619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.566800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:06.567107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.567834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.568081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c43062ac-f837-4951-add0-8805398613c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164702 Sep 06 12:12:06.568286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.568644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1524/3005] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:06.568758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.573011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:06.573621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:06.579434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.579920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.580356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.581045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.581499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.582140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.705849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:06.713700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:06.714544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fe5731bf-0916-4a84-bc2b-b51207a1a487 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159064 Sep 06 12:12:06.715125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1482/3006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:06.722511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f4ce447b-ee70-4886-a229-4d6277d4b14d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.152873 Sep 06 12:12:06.723080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1525/3007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:06.837952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:06.838483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:06.844420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.844902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.845336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.846060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:06.846512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:06.846937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:06.977894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:06.986076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-60d01568-77a0-4994-89ba-9d987827e167 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152132 Sep 06 12:12:06.986700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1483/3008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:06 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:07.595714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:07.596327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:07.603279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:07.603764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:07.604199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:07.604884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:07.605375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:07.605826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:07.738924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:07.740081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:07.746701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:07.746872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:07.747254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:07.747693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:07.748391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:07.748851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:07.749005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:07.749280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:07.756568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:07.757961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:07.759141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9016f2b5-aeca-4c13-b3dd-9d3c1b8aaf65 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167394 Sep 06 12:12:07.759705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1526/3009] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:07.771693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:07.771693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:07.771693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:07.771693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:07.772117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:07.772359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:07.772809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:07.773228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:07.887164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:07.895772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-518c7112-97de-4db2-b60b-d9926dee01a9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160743 Sep 06 12:12:07.896560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1484/3010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:07.915071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:07.923423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-047c096e-927f-4eaa-b4dc-307b0cfbd01c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162771 Sep 06 12:12:07.923984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1527/3011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:08.009714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:08.010245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:08.012379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:12:08.012558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:12:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 (ip 10.222.0.18) !!! Sep 06 12:12:08.021336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.021569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.022037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.022755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.023220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.023650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.155230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:08.164144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a8fe9828-b0f3-4b74-abdc-ab501beab1ca tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158477 Sep 06 12:12:08.164715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1485/3012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:08 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:08.785553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:08.786285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:08.792572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.793056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.793494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.794213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.794669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.795094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.920486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:08.921098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:08.925612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:08.928627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.929032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.929732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.930448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.930908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.931336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.936097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:08.937548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:08.939371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-77b152df-69f7-4ab5-9998-07d4fba74d8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157336 Sep 06 12:12:08.939371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1528/3013] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:08.948549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:08.956500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:08.959526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:08.965000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.965493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.965958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:08.966665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:08.967121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:08.967545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:09.080674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:09.090317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b979ca70-fd97-4a44-9e81-04ba2ec3e0bb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.173633 Sep 06 12:12:09.097934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1486/3014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:09.120091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:09.128483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7af373bf-c4af-47c0-b0fc-311ff7e0b1ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.183725 Sep 06 12:12:09.129065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1529/3015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:09.187230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:09.187851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:09.194515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:09.195002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:09.195445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:09.196153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:09.196613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:09.197060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:09.329844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:09.338498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66e367f3-2929-4dd3-a354-7d39ca389415 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155150 Sep 06 12:12:09.339081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1487/3016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:09 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:09.965592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:09.966260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:09.972683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:09.973311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:09.974498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:09.975100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:09.975563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:09.975985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.104999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:10.114172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:10.114682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:10.115395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:10.115771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:10.116980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd928b47-985c-4912-bc22-c5da6b6f38e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.155315 Sep 06 12:12:10.117809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1530/3017] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:10.122158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:10.122631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:10.123074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.123781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:10.124238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:10.124670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.152603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:10.153585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:10.159699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:10.162155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:10.162690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.163474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:10.164007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:10.164640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.266885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:10.269338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:10.277992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2fb2c074-cd22-4721-a6ce-4ad1a66739a7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166955 Sep 06 12:12:10.278627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1488/3018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:10.312374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:10.321176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0deb4fb-fe31-4aa5-ad81-df3276f61fd9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.172649 Sep 06 12:12:10.321773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1531/3019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:10.362245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:10.362849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:10.369254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:10.369782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:10.370226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.370927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:10.371387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:10.371847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:10.507108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:10.515283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba31c747-e47b-48e7-ba19-4b404d5ebe4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156898 Sep 06 12:12:10.516047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1489/3020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:10 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:11.143168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:11.143779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:11.150534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.151280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.151719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.152425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.152879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.153310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.305044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:11.305775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:11.312501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.312996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.313434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.314176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.314635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:11.314854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.315058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.324153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:11.325784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:11.327158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c4f5dfd0-1a67-4ee9-846a-6195ae95b9f2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.187856 Sep 06 12:12:11.327757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1532/3021] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:11.345831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:11.346842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:11.354342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.354833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.355475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.356182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.356633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.357056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.456386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:11.465599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e77c67c7-294a-4fa9-a44c-daf0dce69c30 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165026 Sep 06 12:12:11.466311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1490/3022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:11.495621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:11.504017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4afac0e4-2dfc-4ece-8d25-88dd5a57c107 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163078 Sep 06 12:12:11.504688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1533/3023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:11.540643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:11.541265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:11.547570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.548081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.548520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.549220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:11.549698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:11.550129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:11.690105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:11.698700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6e790c6d-bc6e-4691-9285-963248367c29 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162775 Sep 06 12:12:11.699269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1491/3024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:11 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:12.352679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:12.353297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:12.359962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.360453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.360892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.361604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.362092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.362521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.491957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:12.492688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:12.499687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:12.499901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.500405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.500950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.501671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.502083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.502544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.509908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:12.511352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:12.512530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-74b4f73c-2b55-40d5-8a31-a079464436b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163983 Sep 06 12:12:12.513102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1534/3025] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:12.530529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:12.531175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:12.538199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.538691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.539128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.539843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.540298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.540718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.639413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:12.649089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b86f57a2-a1cb-4dad-8a85-c76bbe36cd1f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161429 Sep 06 12:12:12.649715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1492/3026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:12.684286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:12.693306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-87c61677-520a-4ffe-b99d-ec55bdf38610 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166534 Sep 06 12:12:12.694174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1535/3027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:12.721823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:12.722444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:12.729550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.730075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.730509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.731211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:12.731656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:12.732079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:12.870558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:12.879002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cdb91ae9-9310-4c21-bba4-33364c3af919 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161082 Sep 06 12:12:12.879617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1493/3028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:12 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:13.538373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:13.539021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:13.545578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.546108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.546549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.547245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.547706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.548135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.674438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:13.675052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:13.680827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:13.682309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.682801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.683246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.683942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.684402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.684828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.689358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:13.690836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:13.693077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6c848902-9e37-476a-9973-2b012f5e04f8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157733 Sep 06 12:12:13.693534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1536/3029] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:13.716695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:13.717404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:13.724089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.724573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.725008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.725718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.726170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.726585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.829254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:13.837566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-87f6f07a-dd73-4473-afde-d177cc805002 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166928 Sep 06 12:12:13.838173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1494/3030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:13.861358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:13.870301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-075c2ed4-73f0-445c-bae0-ee275d0fb146 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157330 Sep 06 12:12:13.870888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1537/3031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:13.902602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:13.903260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:13.909173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.909707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.910156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:13.911382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:13.911895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:13.912361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:14.046989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:14.055890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eb52f5b0-32d6-4739-904c-e82fa52e4769 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157410 Sep 06 12:12:14.056466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1495/3032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:13 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:14.719965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:14.720512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:14.727043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:14.727530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:14.727969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:14.728660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:14.729119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:14.729549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:14.859239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:14.861627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:14.862872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:14.866122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:14.869971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:14.871416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:14.872590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1947cd02-2ed3-4dce-9281-7c7be8052209 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156716 Sep 06 12:12:14.873137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1538/3033] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:14.879013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:14.879512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:14.879942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:14.881255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:14.881724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:14.882150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:14.893968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:14.894590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:14.900595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:14.901330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:14.901796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:14.902491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:14.902956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:14.903380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:15.020573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:15.029291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e42949d-462e-43ae-afc5-765a36fab894 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.171371 Sep 06 12:12:15.029906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1496/3034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:15.055370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:15.063677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-56f7bce5-43da-4e34-b6a2-854f2cc7c43b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173450 Sep 06 12:12:15.064258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1539/3035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:15.079647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:15.080259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:15.086489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:15.086979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:15.087416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:15.088108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:15.088569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:15.088996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:15.219925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:15.228763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ecfd9533-a6ce-4366-9542-70b6fbb0cb88 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153669 Sep 06 12:12:15.229326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1497/3036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:15 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:15.899527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:15.900230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:15.907875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:15.908366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:15.908807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:15.909511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:15.910017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:15.910445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.047640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:16.053267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:16.054093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:16.056690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:16.058195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:16.059400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cbc8b06d-69d0-4064-bb9a-4a3523ccec41 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164367 Sep 06 12:12:16.059965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1540/3037] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:16.060678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:16.061160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:16.061594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.062314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:16.062768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:16.063186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.090816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:16.091465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:16.097834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:16.098329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:16.098766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.099761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:16.100761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:16.101192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.199043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:16.210305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62182824-ad69-4164-940a-11fc39a60dd0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159148 Sep 06 12:12:16.211248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1498/3038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:16.242635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:16.251480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-558a8cbe-e360-4c7a-b31f-5b67581519ea tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164292 Sep 06 12:12:16.251800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1541/3039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:16.252201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:16.252837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:16.262824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:16.263311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:16.263734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.264434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:16.264860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:16.265276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:16.404614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:16.413136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fd42b04f-56bc-4451-bcaa-899bac96f17f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.164671 Sep 06 12:12:16.413724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1499/3040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:16 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:17.087202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:17.087812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:17.094468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.095071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.095520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.096222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.096684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.097116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.225924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:17.234663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:17.234862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:17.235341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:17.236130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:17.237309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e17b4960-4283-4937-9748-bfc8600e4df4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.154705 Sep 06 12:12:17.237899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1542/3041] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:17.242359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.242856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.243292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.243998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.244457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.244888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.275968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:17.276590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:17.282902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.283405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.283832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.284529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.284988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.285414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.300851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:17.380381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:17.389777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8501e6e0-ecdf-423d-881b-dbe3351a3836 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158807 Sep 06 12:12:17.390369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1500/3042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:17.423372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:17.432352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-47647317-197f-4802-8642-c3808ff8a70f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160692 Sep 06 12:12:17.432921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1543/3043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:17.436706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:17.437326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:17.443974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.444459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.444900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.445595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:17.446076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:17.446503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:17.578389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:17.587094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12ac5e97-e1f1-44c7-b4ea-91f842c13511 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154515 Sep 06 12:12:17.587669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1501/3044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:17 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:18.264096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:18.264641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:18.271195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.272241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.272683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.273376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.273864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.274289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.405796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:18.413988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:18.414599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:18.415239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:18.416721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:18.417942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0c9acad1-347d-4cd6-9101-83780afe6ecd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157839 Sep 06 12:12:18.418510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1544/3045] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:18.421077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.421555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.422028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.422715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.423160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.423578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.455430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:18.456048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:18.462422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.462915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.463363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.464061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.464521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.464949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.557474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:18.565695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66f6d1ee-6668-4153-a180-d0f9702da318 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155973 Sep 06 12:12:18.566280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1502/3046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:18.595657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:18.604758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0beb0c77-50ad-4ac7-b785-8d00794fa240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.153119 Sep 06 12:12:18.605336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1545/3047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:18.611199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:18.611825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:18.618048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.618531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.618968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.619655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:18.620113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:18.620538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:18.755611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:18.763901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-85ae4245-24ac-4a0c-bcca-0b9ee3ed42c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156503 Sep 06 12:12:18.764482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1503/3048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:18 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:19.444857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:19.445477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:19.452008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.452492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.452929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.453619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.454106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.454530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.587608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.589764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:19.590412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:19.596283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.596930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.597445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.597760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.597932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.598635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.598936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c01deac1-54d8-48f4-80aa-21a0948c156b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158715 Sep 06 12:12:19.599080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.599518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1546/3049] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:19.599629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.628131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:19.628747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:19.635545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.636036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.636478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.637172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.637635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.638082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.732092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.741244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-58826952-ae25-4c45-9fd4-718793fa64ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155059 Sep 06 12:12:19.742074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1504/3050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:19.774921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.783559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-16a69246-19d2-45bd-b7e7-a74986e26971 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159136 Sep 06 12:12:19.784137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1547/3051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:19.789091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:19.789771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:19.795679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.796225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.796662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.797349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:19.797839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:19.798264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:19.813004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:19.926585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:19.936419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a3931b4e-de35-4246-a786-915e7c9e7e15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151896 Sep 06 12:12:19.937004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1505/3052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:19 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:20.624272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:20.624870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:20.631883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.632356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.632784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.633491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.633969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.634422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.764960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:20.765537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:20.767361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:20.773008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.773500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.773972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.774678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.775137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.775565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.777229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:20.778696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:20.779864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee4c43a4-5cf6-4306-8f6e-af53d3080254 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159483 Sep 06 12:12:20.780429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1548/3053] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:20.807098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:20.807786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:20.814193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.814463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.814897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.815601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.816162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.816489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.912726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:20.921065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4c4b4403-4548-4326-a976-dd26ec715936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159923 Sep 06 12:12:20.921860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1506/3054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:20.954661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:20.961923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:20.962543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:20.963476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-32b3b8be-e38c-43d7-96cc-90d3c621be85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160082 Sep 06 12:12:20.964128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1549/3055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:20.968695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.969184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.969620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:20.970346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:20.970806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:20.971234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.109667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:21.119787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c80bb5c5-cb6d-4efd-9acb-bad6b349da9e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162437 Sep 06 12:12:21.120378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1507/3056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:20 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:21.807124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:21.807709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:21.814152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.814634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.815075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.815755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.816209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.816637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.944281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:21.944888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:21.949142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:21.951324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.951801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.952228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.952917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.953588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.953813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.957962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:21.960160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:21.961344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae8efb68-5ac3-4abd-a707-bd54830af773 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158277 Sep 06 12:12:21.961988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1550/3057] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:21.987492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:21.988212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:21.994980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.995554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.996000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:21.996699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:21.997159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:21.997596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:22.091433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:22.100477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2dcc5b0a-1edb-42df-9d7a-c8262ad66a89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160602 Sep 06 12:12:22.101273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1508/3058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:22.133375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:22.143057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-738b1bb3-c17e-4cc0-84c6-835cc8a1909f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159273 Sep 06 12:12:22.143638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1551/3059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:22.143821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:22.144388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:22.150576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:22.151314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:22.151750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:22.152449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:22.152902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:22.153327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:22.284327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:22.294118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15f0c472-9e39-4687-9941-fdb023fccc9f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154089 Sep 06 12:12:22.294703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1509/3060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:22 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:22.987653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:22.988292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:22.994829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:22.995320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:22.995774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:22.996454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:22.996910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:22.997339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.125196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:23.126034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:23.133112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:23.133318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.133813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.134248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.134943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.135392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.135817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.142105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:23.143594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:23.144778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cbd1e890-9dac-421d-97c2-11f959918ade tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161031 Sep 06 12:12:23.145350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1552/3061] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:23.168280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:23.168796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:23.175074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.175558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.176024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.176738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.177704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.178162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.267563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:23.276332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66ea6c22-1373-4319-965b-672a6a4a9213 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154704 Sep 06 12:12:23.276921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1510/3062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:23.313864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:23.321492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:23.322199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:23.327906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a6205df8-5370-43b5-a339-785a2ead93e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163442 Sep 06 12:12:23.328713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1553/3063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:23.329909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.330348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.330785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.331497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:23.332064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:23.332374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:23.470338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:23.479260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d915026b-87c6-4dd9-8d21-6aba56ea4dbf tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162287 Sep 06 12:12:23.479835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1511/3064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:23 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:24.172005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:24.172628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:24.179648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.180140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.180616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.181302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.181770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.182201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.299931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:24.300659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:24.308699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.309187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.309619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.310590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.311044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.311463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.315641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:24.324913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:24.326390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:24.327640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bf647931-509f-4d3a-9a94-ce8365496591 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159585 Sep 06 12:12:24.328196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1554/3065] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:24.352798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:24.353425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:24.359468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.359958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.360397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.361097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.361555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.362009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.447576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:24.456033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f404c1a-810b-4fdd-85be-c700100f91c1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159914 Sep 06 12:12:24.456855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1512/3066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:24.500326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:24.503958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:24.504567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:24.509351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0d46180-454b-4ac4-862f-b7a9d87b0f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160893 Sep 06 12:12:24.509957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1555/3067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:24.510678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.511154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.511583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.512267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:24.512714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:24.513134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:24.647774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:24.656601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e59ad064-e03b-4091-8f68-bf3605df97b2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156425 Sep 06 12:12:24.657186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1513/3068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:25.354357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:25.354973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:25.361455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.361985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.362424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.363120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.363580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.364008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.481225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:25.481857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:25.488333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.488807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.489236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.489952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.490486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.490910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.507905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:25.518201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:25.519656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:25.521521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-31025374-09e6-4ddf-a1a8-cb39de44d7f9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171850 Sep 06 12:12:25.522823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1556/3069] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:25.532953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:25.533571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:25.540904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.541403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.541888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.542612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.543073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.543506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.632476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:25.641898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-98428003-fd02-4b15-9bd0-fb577f9e87ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164947 Sep 06 12:12:25.642511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1514/3070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:25.680887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:25.681222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:25.681563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:25.687767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.688254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.688695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.689400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:25.689906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:25.690099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a376a95-0751-4b0c-afd3-722ec2c0e5e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160925 Sep 06 12:12:25.690329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:25.690566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1557/3071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:25.835593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:25.843917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-baedf2db-9675-4acd-883a-039c1b0bef7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.167364 Sep 06 12:12:25.844505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1515/3072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:25 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:26.548864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:26.549479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:26.557312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.557847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.558504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.559389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.560035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.560467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.668490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:26.669148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:26.676076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.676689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.677977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.678914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.679373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.679803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.702010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:26.711322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:26.712788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:26.714010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-396e5098-84a5-48e2-b5f0-6cfb352a36d1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169546 Sep 06 12:12:26.714877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1558/3073] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:26.719346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:26.719970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:26.726463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.726950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.727389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.728119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.728548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.728974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.827731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:26.839351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-11889e40-b88b-4772-b7de-7e949c3198d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175649 Sep 06 12:12:26.840280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1516/3074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:26.866243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:26.867396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:26.868006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:26.873871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.874352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.874775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d4689e09-ec2a-4df3-a46f-f3b34167965f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158829 Sep 06 12:12:26.874915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:26.875269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1559/3075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:26.875447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:26.875895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:26.876315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:27.006520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:27.014919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a50159d-9e8e-43cf-9f47-e06ff0991f10 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151322 Sep 06 12:12:27.015494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1517/3076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:26 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:27.741043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:27.741670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:27.748292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:27.748777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:27.749221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:27.749939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:27.750399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:27.750826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:27.754723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:27.862972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:27.863752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:27.871367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:27.871860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:27.872303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:27.873015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:27.873508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:27.873967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:27.889160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:27.898523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:27.900000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:27.901435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5311a119-e017-40ea-b4e6-83b2f883711c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164964 Sep 06 12:12:27.902019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1560/3077] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:27.913959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:27.913959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:27.913959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:27.913959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:27.914402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:27.914884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:27.915336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:27.915752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:28.014168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:28.023478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b82b696c-85d6-479f-ae38-e247a3b7afbd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164367 Sep 06 12:12:28.024069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1518/3078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:28.042814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:28.043526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:28.046835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:28.049532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:28.050085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:28.050522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:28.051213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:28.051666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:28.052899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:28.056657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-04778ff5-5fc2-461e-8248-053ed79045b8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.153629 Sep 06 12:12:28.057477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1561/3079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:28.183248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:28.192026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c5aa097-532b-429d-9aef-60f9a414e547 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152951 Sep 06 12:12:28.192680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1519/3080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:28.928770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:28.929615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:28.936604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:28.937091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:28.937531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:28.938255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:28.938710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:28.939136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.047932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:29.048812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:29.060244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:29.060840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:29.061360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.062203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:29.062697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:29.063192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.079726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:29.089592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:29.091114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:29.092334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e67d8b2-948e-4fd5-b6b6-f0611c7f5238 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168600 Sep 06 12:12:29.092911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1562/3081] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:29.097882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:29.098583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:29.107436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:29.108345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:29.108832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.109575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:29.110239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:29.110877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.229698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:29.238651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3fee2aa6-cc95-48fe-83c0-03410decf65b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.194620 Sep 06 12:12:29.239244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1520/3082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:29.244473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:29.250426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:29.251920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:29.252424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:29.253132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.253559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:29.254046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:29.254474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:29.264995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:29.276684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-813cde1e-3515-47be-9680-d2845b41e0c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.181801 Sep 06 12:12:29.277689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1563/3083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:29.402375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:29.410714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a09ab227-b5e0-4e70-9051-25a436ccd7d6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.169947 Sep 06 12:12:29.411292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1521/3084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:29 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:30.124721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:30.125921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:30.135039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.135898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.136691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.138010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.138852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.139645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.264419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:30.265117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:30.272134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.272631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.273071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.273822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.274282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.274707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.277942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:30.293637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:30.310436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:30.313183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:30.315446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cea6fc06-9a35-42e0-bdfc-6aaead1721f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.197829 Sep 06 12:12:30.316456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1564/3085] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:30.325714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:30.325714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:30.330437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.330923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.331360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.332215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.332516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.332942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.419408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:30.427843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71055e92-dc39-42dc-a8c6-3814826ee211 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167104 Sep 06 12:12:30.441671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1522/3086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:30.441671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:30.441671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:30.441671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.442214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.442214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.442702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:30.443194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:30.443631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:30.481540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:30.492822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e4a50402-bb57-48e6-8cec-7270b3e0ba01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.174555 Sep 06 12:12:30.493434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1565/3087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:30.580350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:30.589588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1bf81905-fa96-4eeb-a991-3b4da608f05b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158998 Sep 06 12:12:30.590200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1523/3088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:31.341968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:31.343659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:31.350387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.350878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.351323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.352026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.352487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.352916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.454230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:31.454830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:31.461228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.461999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.462425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.463181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.463664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.464087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.490552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:31.499435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:31.500968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:31.502328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-43d6b48f-30ef-47a2-826b-d74cbe375779 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164374 Sep 06 12:12:31.502906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1566/3089] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:31.520463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:31.521235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:31.527712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.528190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.528618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.529305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.529779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.530199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.597391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:31.605843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-345b12f8-0953-4c93-a927-a501bb130082 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156015 Sep 06 12:12:31.606425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1524/3090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:31.613619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:31.614248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:31.622892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.623377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.623804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.624486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:31.624934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:31.625351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:31.660901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:31.670179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2aceed87-5935-4d0e-b7f2-4fedd8073b8b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.153468 Sep 06 12:12:31.670768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1567/3091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:31.761041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:31.769134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-39b0cc7b-8856-42e4-a978-997702bbd700 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159151 Sep 06 12:12:31.769807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1525/3092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:31 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:32.529047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:32.529964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:32.536642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.537128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.537570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.538277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.538737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.545882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.632521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:32.633238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:32.640055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.640543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.640986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.641850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.642417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.642915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.679287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:32.688868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:32.690470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:32.690470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6b420df3-660a-4e91-a4a6-5607f7c2d66d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166851 Sep 06 12:12:32.690470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1568/3093] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:32.698101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:32.698908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:32.706363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.706853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.707291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.707988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.709900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.710335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.814511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:32.823999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c95158b9-b864-49ea-9d0d-a2cb77c56149 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.197933 Sep 06 12:12:32.824738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1526/3094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:32.829397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:32.830631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:32.838464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.839214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.839718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.840528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:32.841061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:32.841570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:32.868105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:32.877844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a1ce2fd-9e44-4784-b6d3-b7ff85a5b259 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.182425 Sep 06 12:12:32.878593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1569/3095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:32.995272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:33.005794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8f2827fc-910c-42cb-9688-d51997b67599 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.179357 Sep 06 12:12:33.006518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1527/3096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:32 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:33.718949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:33.719590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:33.726156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:33.726660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:33.727092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:33.727787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:33.728241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:33.728661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:33.852263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:33.852885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:33.860149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:33.860630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:33.861060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:33.861801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:33.862252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:33.862670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:33.879031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:33.888525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:33.890055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:33.891466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8b18f522-c04a-4d96-9aaf-a2a251fa9a56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.176408 Sep 06 12:12:33.892247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1570/3097] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:33.901745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:33.903035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:33.909868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:33.910362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:33.910802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:33.911534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:33.912040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:33.912487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:34.013269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:34.016808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b154d437-36cc-461a-856d-5da9fceec767 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168358 Sep 06 12:12:34.019891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1528/3098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:34.031201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:34.031825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:34.038232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:34.038720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:34.039251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:34.039960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:34.040418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:34.040843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:34.081733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:34.090724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea0a3f44-881a-4cc0-a2a1-b144ee08effc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.192995 Sep 06 12:12:34.091319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1571/3099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:34.180594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:34.189041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9573e6c-0ea6-4809-80ff-c1c0a3144bfc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162518 Sep 06 12:12:34.189633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1529/3100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:34.917534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:34.918282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:34.925000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:34.925483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:34.925950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:34.926638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:34.927095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:34.927523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.041072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:35.042536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:35.049023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.051621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.051621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.051621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.051901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.052311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.066029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:35.079250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:35.081409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:35.082897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1419df79-e022-4a80-b340-c2f059f71df2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169236 Sep 06 12:12:35.083556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1572/3101] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:35.115135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:35.115747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:35.122968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.123435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.123868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.124910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.125041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.125451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.192232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:35.201713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1892554-c34e-484d-a933-4ef170a25aa4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164469 Sep 06 12:12:35.202406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1530/3102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:35.212467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:35.213139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:35.219735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.220215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.220646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.221335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:35.221818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:35.222238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:35.262471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:35.271560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4a7f9331-bc91-40e8-95dc-fcc2a3f4a03b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160302 Sep 06 12:12:35.272149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1573/3103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:35.352066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:35.361149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-990cd4e8-382f-4a7e-9c6e-67f20a32f27c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.152303 Sep 06 12:12:35.361779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1531/3104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:35 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:36.109114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:36.109789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:36.117134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.117256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.117718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.118441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.118907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.119337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.227052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:36.228066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:36.237489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.238291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.238959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.240353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.240788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.241467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.262220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:36.271564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:36.273056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:36.274276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e87e0694-5a64-4701-b5f0-6061544cf085 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169663 Sep 06 12:12:36.274847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1574/3105] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:36.296971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:36.297596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:36.304238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.304731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.305182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.305932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.306392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.306825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.395258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:36.404860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f42c2d6-2194-4d6a-9a0b-61bc3e6d272c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183882 Sep 06 12:12:36.405585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1532/3106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:36.410235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:36.410977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:36.417033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.417668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.418818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.419736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:36.420470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:36.421147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:36.455658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:36.465193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d0b00f8-5afc-4156-9c8e-873adc1bc3e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.172302 Sep 06 12:12:36.465988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1575/3107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:36.563782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:36.571902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cfa4e8d2-fd2e-4527-aad5-429d33eded83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165229 Sep 06 12:12:36.572478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1533/3108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:36 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:37.301086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:37.301758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:37.308297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.309568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.309772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.310464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.310921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.311347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.430191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:37.430815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:37.438513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.439001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.439474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.440310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.440620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.441059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.442901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.445112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:37.455369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.456799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.458010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-765e4a15-06ab-4488-90c6-276ab1d6a4e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160800 Sep 06 12:12:37.458570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1576/3109] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:37.488599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:37.489220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:37.495446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.496539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.497217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.498014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.498490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.498925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.581090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.589885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c65ae99-fd52-4e56-9381-3ce2c0ee00d0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163334 Sep 06 12:12:37.591077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1534/3110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:37.596114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:37.596727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:37.603137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.603620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.604067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.604764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:37.605208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:37.606533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:37.645317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.656420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-444d212c-b09c-4611-aec7-43335a0bf662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.171721 Sep 06 12:12:37.657141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1577/3111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:37.758567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:37.766964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15f361d0-f804-4d10-920e-83c0be990229 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.174479 Sep 06 12:12:37.767557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1535/3112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:37 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:38.484326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:38.484903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:38.492443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.492918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.493346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.494079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.494667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.495272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.614885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:38.615495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:38.621944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.622429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.622870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.623587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.624048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.624471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.627774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.638306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.639831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.641111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a0525502-ac07-4cec-91ad-cda63726f5b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161082 Sep 06 12:12:38.641704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1578/3113] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:38.682620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:38.683247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:38.686390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:38.692219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.692708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.693144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.693868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.694469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.694900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.760661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.769813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc51338b-1f78-47dd-a006-35f3c223a347 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159532 Sep 06 12:12:38.770411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1536/3114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:38.790620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:38.791223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:38.797570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.798143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.798572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.799258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:38.799703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:38.800120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:38.831602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.840630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cc843100-f719-4d26-aa2e-279c06be83e2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161857 Sep 06 12:12:38.841210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1579/3115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:38.941474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:38.951286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8c2a5674-03e1-4127-91bc-7e389c23771d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.164384 Sep 06 12:12:38.951971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1537/3116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:39.669717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:39.670320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:39.676763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.677251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.677712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.678405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.678865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.679292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.794198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:39.794757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:39.800960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.801441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.801929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.802630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.803086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.803514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.813160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:39.821842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:39.823291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:39.825554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a6f3609-da57-401a-9cdd-70687fa8e12f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159904 Sep 06 12:12:39.826178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1580/3117] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:39.864379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:39.865250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:39.871222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.871708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.872148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.872845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.873304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.873764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.937825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:39.940269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:39.948643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e64d276c-ddd2-4ccd-ab45-8eef0fd20c45 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158387 Sep 06 12:12:39.961956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1538/3118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:39.975312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:39.975948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:39.982243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.982620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.983051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:39.983745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:39.984174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:39.984592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.011363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:40.021034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d2d675a-e8cd-4399-ab12-18e4e96f9b9e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160539 Sep 06 12:12:40.021618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1581/3119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:40.127660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:40.135989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-571a6ab8-0088-43e8-a625-f33e9e7835fd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.164673 Sep 06 12:12:40.136562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1539/3120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:39 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:40.852217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:40.852829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:40.859855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.860346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.860787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.861507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.861986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.862418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.974828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:40.975476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:40.982236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.982730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.983210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:40.983926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:40.984387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:40.984819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.011925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.023024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.024606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.026251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-720f5109-a311-434b-8bc2-f35272594232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.177746 Sep 06 12:12:41.033754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1582/3121] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:41.045917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:41.046548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:41.053545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:41.054064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:41.054506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.055247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:41.055711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:41.056176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.158282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.167682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-481291a1-90c2-4c75-a492-0179462511f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.196708 Sep 06 12:12:41.168272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1540/3122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:41.179396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:41.180722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:41.189181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:41.189810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:41.190261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.190977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:41.191444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:41.191879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:41.223162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.232052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-61f07935-0267-4848-babb-31f650ebff21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.190117 Sep 06 12:12:41.232716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1583/3123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:41.338186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:41.347734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a5a71cc5-7474-470a-b954-64524538d839 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.175696 Sep 06 12:12:41.348391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1541/3124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:41 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:42.068303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:42.068981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:42.075545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.076027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.076456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.077281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.077768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.078188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.193279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:42.194102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:42.200721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.201215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.201669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.202396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.202973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.203663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.220616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.230413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.231880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.233565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ad10831-4d64-4132-8644-6595630dd30c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168740 Sep 06 12:12:42.234872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1584/3125] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:42.269002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:42.269628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:42.276276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.276764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.277201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.278002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.278411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.278831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.346709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.355143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-228cd765-3727-49d3-8f50-c81c9979e19a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165743 Sep 06 12:12:42.355720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1542/3126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:42.385599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:42.386744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:42.393838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.394319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.394750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.395434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:42.395879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:42.396303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:42.415049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.424383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7eb31b6-0583-4664-a035-df2f6dbc1c8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159741 Sep 06 12:12:42.424967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1585/3127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:42.534375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:42.542537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e24dcb5c-2172-4501-ac14-88957e01907b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161741 Sep 06 12:12:42.543101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1543/3128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:42 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:43.260506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:43.261225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:43.268273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.268762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.269203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.269961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.270421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.270848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.382965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:43.383539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:43.391056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.391555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.391991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.392701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.393158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.393584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.404679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:43.414543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:43.416024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:43.417222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f4fad6c4-c279-4045-87b6-e82b9add710c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160691 Sep 06 12:12:43.417817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1586/3129] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:43.448493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:43.449114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:43.456185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.456673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.457111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.457927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.458384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.458810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.537992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:43.548051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eacee549-3988-4c85-b45a-558dc3a10803 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168963 Sep 06 12:12:43.548820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1544/3130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:43.566888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:43.568084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:43.575218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.575715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.576158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.577398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:43.577893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:43.578321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:43.628798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:43.637397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-287e04a9-c15c-4a03-979b-bf2b3b7497a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.192634 Sep 06 12:12:43.637940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1587/3131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:43.718382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:43.727937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c2d13f87-97da-4cc1-8b08-2f8811fe3ba2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165787 Sep 06 12:12:43.728556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1545/3132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:43 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:44.443418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:44.444041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:44.450771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.451265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.451718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.452796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.453269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.453739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.572817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:44.573764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:44.575883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:44.581358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.581873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.582312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.583012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.583462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.583882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.590266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.601257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.602788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.604201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5a1b243-3ae1-4923-ab84-b709389e6e23 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164673 Sep 06 12:12:44.604986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1588/3133] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:44.662536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:44.663156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:44.669462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.669988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.670559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.671772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.672272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.672580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.736083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.751879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb464efc-7073-45dc-8910-cc1e58135e0f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.182967 Sep 06 12:12:44.752685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1546/3134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:44.757330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:44.757979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:44.767391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.767897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.768336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.769054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:44.769546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:44.770008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:44.821367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.831322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9b4abd74-7a5a-42e2-95a0-d22055d6c59d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.172717 Sep 06 12:12:44.831930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1589/3135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:44.913820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:44.922319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-19322f3b-2627-48c5-be44-362a36f377ee tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168852 Sep 06 12:12:44.922894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1547/3136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:44 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:45.630997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:45.631610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:45.638316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.638809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.639843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.640563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.641019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.641454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.780968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:45.782447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:45.788789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:45.789486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.790012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.790447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.791156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.793698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.793698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.803313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:45.805111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:45.806401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c82c5745-8495-4e0b-a4b2-8390e8027b4b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.179340 Sep 06 12:12:45.806979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1590/3137] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:45.856965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:45.857597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:45.864938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.865452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.865908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.866635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.867096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.867520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.950866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:45.961283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e701c701-edb0-44b5-804b-f59a699814ac tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.184946 Sep 06 12:12:45.961937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1548/3138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:45.966925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:45.969123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:45.975951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.976839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.977274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:45.978026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:45.978643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:45.979353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:46.027476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:46.036879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a4296bc-117f-4678-90b8-2990b78ffc71 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.184041 Sep 06 12:12:46.037393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1591/3139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:46.122388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:46.131564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a980298-8009-4cd8-8b3d-9799a71b7a1f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168609 Sep 06 12:12:46.132153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1549/3140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:45 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:46.837400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:46.838606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:46.850657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:46.851151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:46.851592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:46.852297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:46.852758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:46.853182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:46.988086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:46.988839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:46.990982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:46.995552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:46.996028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:46.996456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:46.997149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:46.997596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:46.998047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.000066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:47.001511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:47.002894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88f7d8ef-7429-472a-b79e-a3eb54d230e1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.172612 Sep 06 12:12:47.003462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1592/3141] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:47.060468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:47.060996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:47.067111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.067598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.068025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.068720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.069369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.069589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.085658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:47.141498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:47.150153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1aff1f82-f28f-4bf9-80a7-1c98b2bf2ff3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167293 Sep 06 12:12:47.151518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1550/3142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:47.160607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:47.161548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:47.172713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.173576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.174391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.175808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:47.176636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:47.177408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:47.225563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:47.234139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab47a8c4-b066-4646-867d-d0406d4cba1e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.177514 Sep 06 12:12:47.234726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1593/3143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:47.321483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:47.330447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9ec4030b-2b4a-438b-bb5c-1a9a67ce4eef tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.177961 Sep 06 12:12:47.331017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1551/3144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:47 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:48.028908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.029522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.031260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.032270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.036504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.036993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.037426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.038156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.038602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.039022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.039310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.039802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.040264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.041011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.041512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.041930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.068764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:12:48.149412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71b6dd1c-78b9-46cc-b2f9-313de704adb4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 204 len: 0 microversion: 2.1 time: 0.121673 Sep 06 12:12:48.153710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1552/3145] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:12:48 2022] DELETE /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 12:12:48.159590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.160566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.166392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.166874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.167310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.168095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.168453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.168877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.183379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.192787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.194470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.195678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-539ca0c2-d98a-4b19-b61c-15f65b763361 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171201 Sep 06 12:12:48.196242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1594/3146] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:48.201070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.202237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.215059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.215566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.216014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.216729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.217239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.218303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.316148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.318646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:48.326372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-081cf15b-52ed-4961-acbb-236c28fd5071 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170837 Sep 06 12:12:48.327508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1553/3147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:48.332470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.333158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.341168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.343079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.343754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.344548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.345014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.345445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.364339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.372832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-40aaae74-d938-4410-b1c6-a7c7c490788b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175365 Sep 06 12:12:48.373969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1595/3148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:48.384739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:48.385484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:48.394149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.395004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.395780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.397068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:48.397939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:48.398721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:48.491556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.509674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f10d3634-33a1-4faa-8a08-b4fe1e9e776c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.180984 Sep 06 12:12:48.510409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1554/3149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:48.542976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:48.551514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b17a9c11-4cf5-48cc-a079-121ebb614135 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170639 Sep 06 12:12:48.552092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1596/3150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:48 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:49.222816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:49.232013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:49.239216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.239702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.240142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.240835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.241286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.241740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.350082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:49.350699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:49.358681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.359290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.359735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.360458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.360916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.361352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.397089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.407069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.408531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.409839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3725adb1-4e49-40bf-8d33-9bf53b8c8a4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.191182 Sep 06 12:12:49.410421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1555/3151] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:49.414956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:49.415568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:49.422692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.423236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.424325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.424530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.424821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.425240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.503771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.512903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-91e9cfe5-eb0c-4989-aaf3-2218d731b262 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166654 Sep 06 12:12:49.513604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1597/3152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:49.540438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:49.541264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:49.549588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.550248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.550751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.551547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.552811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.552811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.568233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.579843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-86ad0f8e-c93c-4658-badf-2e611b7e7fe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168324 Sep 06 12:12:49.580462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1556/3153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:49.585053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:49.585693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:49.599958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.600456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.600895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.601608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:49.602317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:49.602750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:49.704220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.712730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cbc17908-528a-48ad-b8d9-7b2941cdff25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.176260 Sep 06 12:12:49.713309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1598/3154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:49.962239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:49.971010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-914b8211-0608-4481-b6c9-74490ae21153 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.389603 Sep 06 12:12:49.971641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1557/3155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:49 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:50.436320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:50.436957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:50.443398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.443888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.444330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.445021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.445478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.445941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.537099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:50.537756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:50.544618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.545115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.545621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.546502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.546964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.547395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.694477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.704828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a3fab38c-6e80-44cf-91f1-2f712bbccfa7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.171697 Sep 06 12:12:50.705431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1558/3156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:50.710088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:50.710706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:50.716852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.717688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.718187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.718946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.719406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.719834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.833657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.843035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.844655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.845882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b03759d8-00db-4f58-805f-7a041e511c1b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.413614 Sep 06 12:12:50.846453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1599/3157] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:50.851010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:50.851629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:50.857872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.859116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.859325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.859566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.860277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:50.860735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:50.861270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:50.867901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eb402d9b-f15e-4a58-9bbb-d288cc76f2c5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161433 Sep 06 12:12:50.868652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1559/3158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:50.991560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:50.994698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:50.995317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:51.000159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f3054dd-7c12-4cd5-82a5-80bea474f5b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.152718 Sep 06 12:12:51.000742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1600/3159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:51.001399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:51.002009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:51.002454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:51.003154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:51.003612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:51.004042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:51.135084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:51.144472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-038f2b68-458b-4a7f-8ab0-b9b39f7fe3c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153559 Sep 06 12:12:51.145053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1560/3160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:50 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:51.860394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:51.861079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:51.867623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:51.868115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:51.868556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:51.869266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:51.869766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:51.870203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:51.872511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:51.873233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:51.880777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:51.881281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:51.881754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:51.882480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:51.882937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:51.883372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.023460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.032898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-319f10d4-c5e6-462c-8d25-2e26afbc535d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.308426 Sep 06 12:12:52.033485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1601/3161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:52.038034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:52.038646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:52.039348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.044730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.047000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.047441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.048153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.048612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.049092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.049276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.050679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.051926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-03e974fa-f52a-4439-95b4-695d9b7fd046 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.183359 Sep 06 12:12:52.052503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1561/3162] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:52.057870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:52.058489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:52.066076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.066805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.067402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.068207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.068669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.069103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.187686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.196207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1f6981ef-af1f-417c-8056-403e05f3d400 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161697 Sep 06 12:12:52.196789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1602/3163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:52.201272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:52.201963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:52.207955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.208445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.208883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.209670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:52.210139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:52.210272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.210576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:52.219258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d7e2812-14b0-41b9-b9f1-1a6bfab626ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165741 Sep 06 12:12:52.220085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1562/3164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:52.345762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:52.354071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a7890fb3-7a4a-4de6-9502-7667212d12c0 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156255 Sep 06 12:12:52.354624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1603/3165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:52 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:53.057565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:53.058173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:53.065539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.066059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.066496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.067201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.067652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.068074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.081617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:53.082341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:53.089800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.090288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.090717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.091421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.091870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.092319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.206247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.222754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d6526b78-0001-48ab-a66e-34b64e474a38 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.169326 Sep 06 12:12:53.223611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1563/3166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:53.228632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:53.229250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:53.232626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.238713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.238713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.238713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.239582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.239929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.240474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.246363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.247849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.250446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a244001f-7136-4e4e-bea0-4f8dc9cda97f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.173339 Sep 06 12:12:53.251028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1604/3167] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:53.262478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:53.263115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:53.269519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.270057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.270495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.271410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.271896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.273698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.398376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.407291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-716ecbca-628d-4262-9355-f792bd00332a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.182328 Sep 06 12:12:53.407863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1564/3168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:53.412438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:53.413192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:53.419001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.419554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.419990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.421242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:53.421739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:53.422109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:53.423947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.433083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-55c24ba6-3e24-47ea-aed3-22002bd688b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.180994 Sep 06 12:12:53.433942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1605/3169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:53.575265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:53.585803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6401b1fd-3575-4a82-b8e8-c2fc4031d354 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.176830 Sep 06 12:12:53.586553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1565/3170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:53 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:54.247738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:54.248399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:54.255765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.256253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.256683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.257409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.257890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.258313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.278031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:54.278676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:54.285492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.286026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.286458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.287170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.287606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.288026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.419236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.428919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-120dd4b7-e233-45d7-a79d-bbebb5fedbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.184965 Sep 06 12:12:54.429531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1606/3171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:54.434500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:54.435115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:54.441939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.442646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.443413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.444113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.444571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.444997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.446001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.455976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.457440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.458706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0944a58-af2a-4f7f-b8a9-07f4254a6b97 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.185215 Sep 06 12:12:54.459270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1566/3172] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:54.470534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:54.471146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:54.477951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.478465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.478858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.479558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.480006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.480425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.591365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.603381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-13545d50-5ab6-4f65-9300-578c23eba3e9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172453 Sep 06 12:12:54.604145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1607/3173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:54.612425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:54.613058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:54.619595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.620098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.620537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.621263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:54.621761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:54.622196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:54.636560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.646287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-456485ad-3910-4f4c-a502-1bbe560c9961 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.185297 Sep 06 12:12:54.646978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1567/3174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:54.780790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:54.789377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f883c2a8-5cb9-44d0-b0a5-21d35f675931 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.184085 Sep 06 12:12:54.790001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1608/3175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:54 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:55.453586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:55.454232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:55.460689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.461166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.461594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.462304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.462754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.463170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.485862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:55.486464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:55.492940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.493425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.493890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.494598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.495049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.495478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.598595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.606982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cab466bf-273b-468a-b3d5-629c79801931 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157782 Sep 06 12:12:55.607558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1568/3176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:55.627660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:55.628265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:55.631364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.634295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.634786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.635215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.635908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.636359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.636779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.641288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.642860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.644169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea858f12-246e-462d-8014-defac3e0bed0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162837 Sep 06 12:12:55.644827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1609/3177] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:55.671371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:55.672106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:55.678416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.678982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.679500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.680270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.680824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.681325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.685725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:55.778336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.792788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ee31830-7558-4f12-a349-bed39b3a1af7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168870 Sep 06 12:12:55.793588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1569/3178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:55.815206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:55.815825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:55.816527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.821812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.822298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.822729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.823419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:55.823872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:55.824294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:55.824823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e67fe45d-261a-47c8-9ebb-3f5fae4f62d4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157252 Sep 06 12:12:55.825460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1610/3179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:55.840300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:55.968422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:55.976731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a5198e2-10f9-4e31-bb71-8e8c2097c6cb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.166628 Sep 06 12:12:55.977301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1570/3180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:55 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:56.629970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:56.630561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:56.636660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.637185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.637630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.638360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.638826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.639275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.672167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:56.672913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:56.679600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.680183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.680625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.681326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.681824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.682251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.773119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:56.782359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bd72b9d5-aa0e-405e-8e1c-7170ecbb343b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156344 Sep 06 12:12:56.783160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1611/3181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:56.816779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:56.817326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:56.817480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:56.823349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.823825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.824254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.824935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.825383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.825827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.826197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:56.827705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:56.828888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f27b0948-2c48-4235-b8b0-ac13d73bf00f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161459 Sep 06 12:12:56.829451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1571/3182] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:56.849166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:56.849809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:56.856323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.856826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.857267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.858606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:56.859269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:56.859702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:56.959590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:56.968440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8c1298d0-3dc7-4340-900b-19c5a52a1b19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155383 Sep 06 12:12:56.969026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1612/3183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:56.993570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:56.999670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:57.000484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:57.003753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8b222ce7-b0af-4584-8fe7-6e100dc9eaef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158158 Sep 06 12:12:57.016048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1572/3184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:57.016261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.016261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:57.016261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:57.016261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.016691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:57.016691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:57.144831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:57.153569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc846f38-30b5-40bf-8c75-68e7a4b37b91 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157781 Sep 06 12:12:57.154205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1613/3185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:56 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:57.808025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:57.808587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:57.815737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.816219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:57.816657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:57.817341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.817834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:57.818261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:57.862951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:57.863753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:57.870107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.870587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:57.871045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:57.871732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.872181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:57.872590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:57.954455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:57.962815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6e6b7fcd-9b85-435e-8d1e-5e65872366a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158632 Sep 06 12:12:57.963393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1573/3186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:57.992059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:57.992675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:57.999160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:57.999650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.000104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.000789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.001245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.001693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.012354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:58.021685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:58.023145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:58.024330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-51dff426-2ada-41bf-b959-87988df10df9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165254 Sep 06 12:12:58.024919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1614/3187] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:12:58.036003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:58.036887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:58.042994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.043522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.043954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.044651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.045676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.046111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.142215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:58.150797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ae24d7e-94b6-408a-acab-70ab620c666b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162547 Sep 06 12:12:58.151715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1574/3188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:58.177431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:58.178157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:58.184151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.184634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.185066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.185975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:58.186345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.186864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.187297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.195352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af20b36c-f96c-46eb-bc22-4065662cca07 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165266 Sep 06 12:12:58.196157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1615/3189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:58.319946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:58.328979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba743a73-e05e-4ae1-8270-5b3edca6468a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155385 Sep 06 12:12:58.329547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1575/3190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:58 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:12:58.986896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:58.987501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:58.994108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.994595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.995036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:58.995729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:58.996189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:58.996620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.051690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:59.052322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:59.060795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.061997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.063558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.063846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.064242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.064757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.134300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.143639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a409a501-cae7-4aea-b965-0da28f68c72d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161311 Sep 06 12:12:59.149705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1616/3191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:59.175865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:59.176493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:59.182900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.183375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.183842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.184540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.184998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.185422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.208433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.218007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.219470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.220731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e10de558-16f1-4593-b185-7f5f30773220 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.173397 Sep 06 12:12:59.221332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1576/3192] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:12:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:12:59.225757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:59.226364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:59.233440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.233765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.234186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.234890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.235352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.235775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.323475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.332659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c75a2ded-d2e6-4e06-87bb-01d9c25a7f70 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160752 Sep 06 12:12:59.333258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1617/3193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:59.352575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:12:59.353202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:12:59.359664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.360154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.360591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.361284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:12:59.361765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:12:59.362193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:12:59.370689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.379816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d4996734-659e-4cc8-9fe6-9250a0c0e190 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157442 Sep 06 12:12:59.380516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1577/3194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:12:59.499189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:12:59.507441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a3001b4-2fde-4566-bdd6-23fb81ff583b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158766 Sep 06 12:12:59.507965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1618/3195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:12:59 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:00.168546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:00.169208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:00.175887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.176552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.176819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.177526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.178070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.178528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.246309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:00.247671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:00.254907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.255403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.255849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.256698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.257158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.257598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.315812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.324240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-60fc33fb-6f46-4411-9d9f-c5a4c59c2093 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159581 Sep 06 12:13:00.324826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1578/3196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:00.356611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:00.357231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:00.363244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.363731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.364172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.364872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.365334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.365809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.394926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.404259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.405888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.407060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3376e91b-9ba2-4262-abaa-d5da1a510021 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164813 Sep 06 12:13:00.407619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1619/3197] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:00.414674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:00.415287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:00.422061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.422482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.422921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.423792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.424230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.424656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.507996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.517191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1cf7c7de-4f53-4a0a-9da0-a0d933d6f893 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164349 Sep 06 12:13:00.518045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1579/3198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:00.530922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:00.531920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:00.537546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.538059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.538495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.539200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:00.539929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:00.540073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:00.562865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.571208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c4841d16-968f-40f4-b315-b89cc258bc19 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160318 Sep 06 12:13:00.571776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1620/3199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:00.672506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:00.680650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-94d34349-01aa-4b14-8d3c-93615efc3b98 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154488 Sep 06 12:13:00.681224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1580/3200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:00 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:01.348150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:01.348770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:01.355232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.355726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.356170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.356864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.357326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.357872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.432350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:01.433146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:01.442240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.442731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.443167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.443900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.444359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.444922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.491607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.500607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b35a0396-26e2-4769-b13f-96661f1c158f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156484 Sep 06 12:13:01.501188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1621/3201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:01.540275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:01.540887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:01.547529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.548007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.548437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.549119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.549572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.550029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.583098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.592558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.594051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.595235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91d86ed6-ff3f-456c-856c-87ac8c47a9c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166974 Sep 06 12:13:01.595808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1581/3202] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:01.600198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:01.600804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:01.606748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.607224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.607806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.608519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.608971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.609392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.681476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.690039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1f6cf839-5d41-4c8d-9370-fb9d6302027d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.153511 Sep 06 12:13:01.690975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1622/3203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:01.704998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:01.705626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:01.711741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.712231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.712670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.713368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:01.713861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:01.714288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:01.746658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.755127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a5541fa-d943-416a-b0c1-630d4949c714 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158329 Sep 06 12:13:01.755859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1582/3204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:01.851611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:01.860204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-70d1646e-07ca-4599-8722-23e1a03ea109 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159979 Sep 06 12:13:01.860787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1623/3205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:01 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:02.523896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:02.524455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:02.531943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.532428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.532873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.533567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.534057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.534489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.620215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:02.620830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:02.627775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.628275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.628693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.629378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.629858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.630288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.667254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:02.675906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9bb2a975-8104-4dd1-9146-43c0459d95a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155942 Sep 06 12:13:02.676492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1583/3206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:02.713855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:02.714546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:02.722224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.722793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.723560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.724254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.724706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.725120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.762955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:02.773587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:02.775836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:02.777744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e4f43677-3c44-43e1-aef5-603c844de001 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161172 Sep 06 12:13:02.778546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1624/3207] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:02.784250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:02.785166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:02.792713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.793194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.793926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.794627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.795870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.796416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.859631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:02.867973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0c47693b-83f2-4b8e-b3c7-f0210ff3819b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158093 Sep 06 12:13:02.868556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1584/3208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:02.884299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:02.884952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:02.891120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.891619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.892060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.892764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:02.893225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:02.893731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:02.933235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:02.942592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-644f447e-d3fb-475a-b302-e7adc977dd96 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161738 Sep 06 12:13:02.943611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1625/3209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:03.026897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:03.035974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a308b622-a312-43f8-bb5c-2eba5bbacdf2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156110 Sep 06 12:13:03.036551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1585/3210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:02 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:03.700529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:03.701777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:03.708393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:03.708871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:03.709303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:03.710025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:03.710482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:03.710901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:03.804138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:03.804752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:03.811747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:03.812233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:03.812665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:03.813353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:03.813905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:03.814324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:03.843831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:03.846056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:03.853688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a1a7ad05-3f98-4276-bf0c-91e9ed8f017c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157093 Sep 06 12:13:03.854264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1626/3211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:03.891564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:03.892188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:03.898875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:03.899368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:03.899811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:03.900514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:03.901226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:03.901680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:03.962656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:03.977041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:03.979279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:03.980881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3337188-c7e6-431d-b494-196778b1bf22 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.180450 Sep 06 12:13:03.982344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1586/3212] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:03.990935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:03.991647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:04.000554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:04.000972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:04.002005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:04.002242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:04.002821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:04.003336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:04.008076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:04.050217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:04.058941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-369dc752-2223-49ab-8c56-50d227dea9ee tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.171388 Sep 06 12:13:04.069814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1627/3213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:04.075019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:04.075902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:04.083165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:04.083744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:04.084256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:04.085030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:04.085708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:04.086141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:04.148289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:04.157271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-427966bb-5d39-48ae-b870-26ccf6186794 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.172465 Sep 06 12:13:04.157883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1587/3214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:04.219817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:04.228047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a36193e-7128-4859-a5da-c7011cb290c8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156983 Sep 06 12:13:04.228624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1628/3215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:04 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:04.877451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:04.878102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:04.884603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:04.885091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:04.885537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:04.886257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:04.886717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:04.887146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.008767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:05.009382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:05.011820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:05.017798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.018288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.018725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.019428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.019883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.020306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.022047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.031558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-24667054-ea02-42f9-8d34-5a241b81aa20 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157992 Sep 06 12:13:05.032145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1588/3216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:05.084412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:05.085058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:05.091100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.091586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.092020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.092715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.093704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.094199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.156381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.166021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.167480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.168670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-10a63350-20bb-49b9-932c-17becd82e145 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164087 Sep 06 12:13:05.169275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1629/3217] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:05.180181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:05.180925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:05.187386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.187968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.188483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.189226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.189723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.190159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.227176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.235980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-51e2c4df-398a-4ca6-92cc-0ba8a6680aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155382 Sep 06 12:13:05.236579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1589/3218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:05.256417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:05.257192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:05.266285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.266799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.267226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.267937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:05.268396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:05.268827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:05.335079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.343188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9cfafdc1-5ae9-4bf6-84b0-70c67b3a94ce tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166678 Sep 06 12:13:05.343840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1630/3219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:05.404981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:05.414121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-39e062e7-8cb7-4fdb-9eef-a4c280a7957c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162774 Sep 06 12:13:05.414701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1590/3220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:05 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:06.055696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:06.056284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:06.063294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.063784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.064225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.064917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.065376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.065835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.196521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:06.197145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:06.197322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.203803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.204285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.204730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.205471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.205824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4124b2e7-dd20-4b57-85a8-b5ce51ca5bcb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154001 Sep 06 12:13:06.206006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.206373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.206561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1631/3221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:06.259638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:06.260270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:06.267402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.267902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.268345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.269119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.269583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.270209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.345159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.354546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.356085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.357344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ff6cab5-dd23-41c0-bf35-844bd9142b37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164968 Sep 06 12:13:06.358021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1591/3222] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:06.366678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:06.367401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:06.373520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.374156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.374880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.375764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.376227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.376651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.408360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.417015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-53c9a20a-24d5-4615-b9e9-e39abf7abf1a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161449 Sep 06 12:13:06.417583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1632/3223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:06.438044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:06.438668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:06.444702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.445185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.445624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.446379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:06.446829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:06.447257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:06.513598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.525333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-10648e5b-cc48-4b62-8655-5318ffdc115c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161502 Sep 06 12:13:06.526266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1592/3224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:06.654977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:06.664682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c06800e5-7afd-42ac-b2b7-cfca12506318 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.230795 Sep 06 12:13:06.665556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1633/3225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:06 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:07.229691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:07.230317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:07.232724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:07.238878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.239401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.239846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.240545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.241007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.241436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.376122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.383693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:07.384326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:07.385119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-38bfadf6-202c-4eeb-b44c-0bd2683acce7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159319 Sep 06 12:13:07.385714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1593/3226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:07.391535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.392015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.392452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.393148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.393601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.394053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.441771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:07.442427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:07.448482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.448971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.449409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.450131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.450586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.451011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.536805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.545807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.547884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.549164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f17dce0b-3471-4a93-9449-0c1df0d88f13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169334 Sep 06 12:13:07.549849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1634/3227] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:07.554487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:07.555201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:07.561618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.561618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.562900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.563678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.564214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.564713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.587954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.596964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fdb68aea-980e-4100-9795-6a302cf48f8b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159836 Sep 06 12:13:07.597789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1594/3228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:07.688876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:07.689498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:07.695447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.695961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.696349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.697122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:07.697593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:07.698041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:07.709589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.718603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-782729ee-4174-46b9-98c3-1f3b42ab08c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166852 Sep 06 12:13:07.718603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1635/3229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:07.831757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:07.839901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0e7f4a40-09c6-4218-b12a-6e7b29baf8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155491 Sep 06 12:13:07.840465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1595/3230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:07 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:08.409991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:08.410693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:08.417654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.418167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.418643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.419316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.419779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.420215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.560779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:08.570059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99d1a705-60a0-4ece-8a28-2c1abe2e6ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164074 Sep 06 12:13:08.570938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1636/3231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:08.575521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:08.576173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:08.584100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.584593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.585028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.585763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.586224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.586646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.620359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:08.621069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:08.628741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.629347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.629831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.630539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.630997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.631451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.722367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:08.731065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:08.732667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:08.733757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba7a6585-d1fe-48b7-9537-167755d9c45d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162031 Sep 06 12:13:08.734577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1596/3232] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:08.742486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:08.743269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:08.750613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.751244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.751779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.752584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.753126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.753619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.789860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:08.799242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-63e84196-bb99-4d20-893f-c9e2cb1a1dc1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.182640 Sep 06 12:13:08.800213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1637/3233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:08.864673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:08.865322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:08.871225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.871712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.872150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.872849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:08.873307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:08.873759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:08.896928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:08.906312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-28b6b598-aed4-4f66-9efb-2016734c3230 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167293 Sep 06 12:13:08.907072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1597/3234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:09.003217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:09.011450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f13f320-cd39-440b-9cf6-fabc17b56072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.150706 Sep 06 12:13:09.011961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1638/3235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:08 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:09.593712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:09.594339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:09.600534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.601016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.601455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.602163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.602627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.603046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.746526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:09.755538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cb3fade8-5c89-455f-8907-b60f4899d436 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165801 Sep 06 12:13:09.756110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1598/3236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:09.760016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:09.760632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:09.767602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.768085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.768519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.769470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.769682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.770120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.823746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:09.824488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:09.830691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.831172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.831603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.832289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.832735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.833151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.907161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:09.916127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:09.917685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:09.918888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-16acafdd-1c7d-48ef-993d-7a60c48a3830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162854 Sep 06 12:13:09.919619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1639/3237] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:09.931036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:09.931713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:09.938262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.938855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.939301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.940003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:09.940468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:09.940898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:09.967391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:09.975958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a65c461b-107c-4373-af52-7c25384427b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155971 Sep 06 12:13:09.976558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1599/3238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:10.036769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:10.037865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:10.047737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:10.048648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:10.049405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:10.050759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:10.051587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:10.052241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:10.076089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:10.085114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5cc5a5e-2339-4d0e-b6e9-70a83a69d366 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157962 Sep 06 12:13:10.085723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1640/3239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:10.197742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:10.206242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f6e1983-feac-422f-ab7c-745827817648 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.175593 Sep 06 12:13:10.206829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1600/3240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:10 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:10.779611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:10.780278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:10.787409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:10.787891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:10.788323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:10.789008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:10.789477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:10.789911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:10.919343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:10.927839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-228b0954-9a87-494c-808e-6051aea838d0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152310 Sep 06 12:13:10.928412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1641/3241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:10.946637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:10.947248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:10.954438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:10.955084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:10.955350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:10.956049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:10.956506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:10.956934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.000329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:11.000977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:11.007040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.007525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.007963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.008655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.009109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.009534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.089558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:11.099094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:11.100538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:11.101740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-58818f29-fb3b-4c66-b595-d44cc0454a66 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159064 Sep 06 12:13:11.102300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1601/3242] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:11.108315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:11.109170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:11.115841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.116351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.116783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.117683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.118312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.118732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.151376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:11.160285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-df502082-0df7-4272-b2ed-782c6165053f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164326 Sep 06 12:13:11.160925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1642/3243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:11.230204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:11.230838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:11.238216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.238811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.239318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.240086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.240572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.241128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.255288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:11.262752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:11.263861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-162b471e-d8df-44de-9e5c-fb6502c25559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159002 Sep 06 12:13:11.264449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1602/3244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:11.376775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:11.385063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c92bc989-0bf2-45e8-b166-99d1dc703956 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158762 Sep 06 12:13:11.385639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1643/3245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:11 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:11.953921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:11.954549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:11.961140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.961634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.962106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:11.962813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:11.963273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:11.963794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.100653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.102885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:12.110585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0330dbc-1110-425d-aa4a-286f83c03d29 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161603 Sep 06 12:13:12.111165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1603/3246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:12.128284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:12.129131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:12.135477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.135889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.136316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.137003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.137447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.137895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.184421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:12.185057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:12.191925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.192410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.192841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.193535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.194087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.194510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.282485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.306365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.307876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.309072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-abe05afc-8f0b-4ac6-881a-d6f03009601f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.185600 Sep 06 12:13:12.309716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1644/3247] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:12.326321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:12.327419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:12.333408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.334017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.334459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.335157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.335613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.336039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.337508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.346919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09b9b599-ffde-4f2c-8e58-84ee296563ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166310 Sep 06 12:13:12.347634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1604/3248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:12.409974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:12.410606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:12.416722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.417210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.417661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.418459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:12.418822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:12.419243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:12.477001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.486336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc948561-cbdc-4df1-88c4-be4d42371db6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163886 Sep 06 12:13:12.486922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1645/3249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:12.571137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:12.579509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04d7ccf4-47d1-477d-bad9-f0b94d220889 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.174619 Sep 06 12:13:12.580090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1605/3250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:12 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:13.134504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:13.135051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:13.142726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.143209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.143649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.144332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.144784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.145208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.275055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.284213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-089b5d4c-98fd-40cd-83f1-ed47ae6371b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153731 Sep 06 12:13:13.284781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1646/3251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:13.335383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:13.336002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:13.342475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.343460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.343897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.344624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.345082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.345510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.370904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:13.371518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:13.377851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.378337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.378768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.379461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.379923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.380471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.478998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.488084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.489449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.490654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f0dbc20-a724-4b10-bbfd-e4d9ebdca49f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159245 Sep 06 12:13:13.491213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1606/3252] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:13.509520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:13.510174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:13.516932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.517420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.518033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.518641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.519063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.519494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.520575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.529029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7fcbcd0-dcee-4828-9c18-3087c899357e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161926 Sep 06 12:13:13.529608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1647/3253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:13.602917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:13.603540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:13.609715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.610210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.610643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.611344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:13.611821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:13.612229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:13.653927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.662820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-43952950-a1c9-4e43-bd8e-a5183b1fd15c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157127 Sep 06 12:13:13.663399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1607/3254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:13.745012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:13.753297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-982f2a22-2726-4232-aecf-b11cc05afcdc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154183 Sep 06 12:13:13.753896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1648/3255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:13 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:14.307109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:14.307665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:14.314393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.314877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.315311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.316000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.316453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.316878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.448255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.459686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bdf1d6b1-60cd-42ff-b955-14d952912314 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155603 Sep 06 12:13:14.460467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1608/3256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:14.517966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:14.518579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:14.524987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.525470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.526181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.526874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.527327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.527748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.552412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:14.553205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:14.559216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.559642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.560079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.560862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.561260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.562194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.667607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.677423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.678999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.680177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fdeeadc8-13e0-45fb-bc02-8becad50270d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167616 Sep 06 12:13:14.680934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1649/3257] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:14.686785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:14.687436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:14.693618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.694145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.694587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.695294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.695756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.696182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.697824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.706400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6bf5ea34-78c2-4283-80f4-180547174771 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157874 Sep 06 12:13:14.706985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1609/3258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:14.777161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:14.777800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:14.784419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.784896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.785328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.786180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:14.786623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:14.787039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:14.829192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.837804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca02f93f-1e18-422e-91a2-39afb20bc44a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154642 Sep 06 12:13:14.838491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1650/3259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:14.920607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:14.929424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cae55e1f-c7f5-4cc8-bed4-51a8727b4a5b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156526 Sep 06 12:13:14.930034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1610/3260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:14 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:15.485824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:15.486442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:15.492546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.493046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.493479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.494213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.494709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.495137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.632023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:15.641441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5395c1bd-66f6-4f1a-8c47-12d8ce2e3777 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159626 Sep 06 12:13:15.642091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1651/3261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:15.706925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:15.707567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:15.714051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.714535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.714971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.715659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.716119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.716546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.730117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:15.730738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:15.737298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.737740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.738185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.738897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.739357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.739781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.853729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:15.866890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:15.868501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:15.869820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02fa600b-6b74-4694-8793-f0018be968ce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166983 Sep 06 12:13:15.870424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1611/3262] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:15.876158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:15.876788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:15.882309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:15.883439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.884106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.884554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.885274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.885761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.886192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.892087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c419668c-c387-4728-8f28-1a306b996410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165720 Sep 06 12:13:15.892685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1652/3263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:15.953639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:15.954292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:15.960644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.961140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.961575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:15.962315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:15.962779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:15.963207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:16.033545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:16.042026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0f0df5d-c2f2-487e-94cc-6071794ac0c8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.170490 Sep 06 12:13:16.042617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1612/3264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:16.101629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:16.111345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b73fd0d2-6fcd-4a0c-b40b-6141cc1c8571 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161770 Sep 06 12:13:16.112036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1653/3265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:15 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:16.665114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:16.665768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:16.671746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:16.672222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:16.672656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:16.673340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:16.673827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:16.674265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:16.803175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:16.811419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7ec0baf4-e8d2-4c26-b0dc-23626e0f71ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.150195 Sep 06 12:13:16.812509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1613/3266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:16.897158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:16.897831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:16.904540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:16.905029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:16.905552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:16.906333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:16.906799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:16.907233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:16.915883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:16.916459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:16.923024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:16.923513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:16.923948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:16.924641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:16.925096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:16.925521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.044250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.053474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.055332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.056522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bd0e8764-eef8-4d56-81b5-0b8eab46683f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163294 Sep 06 12:13:17.057087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1654/3267] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:17.059322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.065679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:17.066517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:17.069191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b5812dda-4469-4d0f-ab49-796addf0eea1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157192 Sep 06 12:13:17.069801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1614/3268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:17.072723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:17.073212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:17.073669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.074366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:17.074820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:17.075244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.135144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:17.135921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:17.141891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:17.142383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:17.142826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.143527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:17.143984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:17.145018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.207808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.216358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-88f7d315-30a8-43ac-a12b-6c5dad7c860a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154838 Sep 06 12:13:17.217219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1655/3269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:17.284747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.293033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ee32ea7e-5460-463c-b013-89c5dad9b4d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161957 Sep 06 12:13:17.293596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1615/3270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:17 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:17.835100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:17.835625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:17.841573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:17.842082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:17.842517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.843821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:17.844459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:17.844881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:17.980101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:17.989886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a0281106-ae77-4229-af6f-8a026d7e64b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158678 Sep 06 12:13:17.990461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1656/3271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:18.090467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:18.091032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:18.092024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:18.092634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:18.098343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.098835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.099238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.099360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.099720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.099958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.100156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.100418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.100843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.100957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.101297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.101753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.236319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:18.238196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:18.244983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:18.246578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:18.246732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-69e36d4a-4531-4604-b574-bf0fb9dbc185 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158326 Sep 06 12:13:18.247465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1657/3272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:18.248418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9a6c53a2-d6d3-42bc-9ca0-d7bdd3670906 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161956 Sep 06 12:13:18.249191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1616/3273] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:18.266997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:18.267619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:18.273764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.274369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.274806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.275489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.275940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.276629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.317671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:18.318323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:18.324260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.324708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.325144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.325890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:18.326347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:18.326921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:18.411998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:18.420585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4d879492-41ac-4eb5-9ee3-fb47b8c4b849 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158268 Sep 06 12:13:18.421304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1658/3274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:18.464713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:18.473235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-73387328-5f6b-47ae-9541-b877312e29f7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159601 Sep 06 12:13:18.473833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1617/3275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:18 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:19.013785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:19.014424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:19.021585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.022100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.022538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.023225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.023682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.024108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.172553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.181030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bdf84c7b-d07f-4ec6-9ccf-a02dc8bae357 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.171116 Sep 06 12:13:19.181609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1659/3276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:19.270440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:19.270976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:19.273963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:19.274590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:19.277855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.278332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.278761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.279453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.279914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.280867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.281316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.281833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.282276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.282971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.283428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.283859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.287960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:19.419338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.422820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.428569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62d32cf1-2357-4fee-b58d-7aa7a451728f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162111 Sep 06 12:13:19.429385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1618/3277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:19.432493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.433950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.435112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90653f3f-e196-4b95-8aed-45fd199e1cca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164975 Sep 06 12:13:19.435822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1660/3278] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:19.443546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:19.444322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:19.450346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.450825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.451260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.451943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.453545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.453996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.495178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:19.495823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:19.502752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.503246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.503680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.504402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:19.504851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:19.505271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:19.588084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.597005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-773c5935-e337-4fd8-86b1-4f23483d2463 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157261 Sep 06 12:13:19.597585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1619/3279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:19.638612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:19.647734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e0db5835-a715-4346-b116-8e4e75b74e1a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156301 Sep 06 12:13:19.648319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1661/3280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:19 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:20.205129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:20.205773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:20.211825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.212379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.212747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.213434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.213916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.214350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.229452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:20.345618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.353732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e8e364b3-cf7d-4d13-bdd0-b672ce086e03 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152566 Sep 06 12:13:20.354303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1620/3281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:20.451527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:20.452224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:20.460379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.460884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.461223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.461871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:20.462022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.462383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.462710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:20.462842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.469017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.469506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.469989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.470698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.471156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.471587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.601951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.603352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.611746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.612975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a6c2bb08-92dc-4581-a8ca-e8b327059346 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165193 Sep 06 12:13:20.613191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.614042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1662/3282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:20.614481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-236299bf-73eb-4ccb-a228-6a19a5d2e407 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157568 Sep 06 12:13:20.615199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1621/3283] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:20.623151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:20.623849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:20.630463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.630958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.631404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.632090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.632551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.632976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.673037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:20.673672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:20.679596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.680083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.680524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.681219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:20.681703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:20.682134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:20.767486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.776471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-302ebc05-e33b-46e6-97e0-4d50434fa416 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156838 Sep 06 12:13:20.777160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1663/3284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:20.816509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:20.824804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8b2a6a07-5343-42da-9134-fd807ace4fc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156320 Sep 06 12:13:20.825374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1622/3285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:20 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:21.377687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:21.378364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:21.384327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.384799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.385228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.385925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.386374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.386792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.516298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:21.524758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ae3ece4-edee-4a15-8998-90ca1a6d625d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.150863 Sep 06 12:13:21.525171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1664/3286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:21.637029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:21.637730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:21.639970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:21.640589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:21.645619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.646130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.646560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.647257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.647719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.648141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.648336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.648824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.649590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.650594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.651448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.651999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.782778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:21.787175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:21.791157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f30128b2-3bf2-4f73-aa17-2d874ebf2252 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157927 Sep 06 12:13:21.791742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1623/3287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:21.796212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:21.798002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:21.798854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b2e1b517-a7dc-4254-85ce-75843d0548fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162824 Sep 06 12:13:21.804361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1665/3288] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:21.804545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:21.804545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:21.808798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.809278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.809753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.810447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.810902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.811327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.849511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:21.850161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:21.856114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.856602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.857035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.857753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:21.858211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:21.858637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:21.947303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:21.956057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-134d897d-18d2-4b32-b0b5-fd5b503892e0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159823 Sep 06 12:13:21.956886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1624/3289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:21.995295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:22.004776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4c8ea612-6922-4895-9af9-f1802e197b33 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159159 Sep 06 12:13:22.005340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1666/3290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:21 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:22.549830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:22.550464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:22.556576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.557061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.557500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.558219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.558678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.559103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.689959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:22.698255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-017d1668-e330-4fc8-b3bb-eef2abbbd1d8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152967 Sep 06 12:13:22.698831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1625/3291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:22.815180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:22.815719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:22.822585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.823090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.823534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.824432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.824580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:22.824708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.825078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:22.825200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.832319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.832809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.833278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.834009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.834481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.834918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.959927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:22.968077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:22.968401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7199f6b1-b392-427a-84b7-832862f2e4ca tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157699 Sep 06 12:13:22.968993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1667/3292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:22.976821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:22.978295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:22.979202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:22.979457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b09b9dfa-2f0f-4113-a019-bc17682e12d4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159008 Sep 06 12:13:22.980184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1626/3293] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:22.980329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:22.986995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.987565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.988077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:22.988844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:22.989376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:22.989916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:23.028278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:23.028888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:23.035095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:23.035571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:23.035998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:23.036685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:23.037129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:23.037549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:23.124785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:23.134504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50727352-f6fd-40d4-8490-8c564be4c51e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159262 Sep 06 12:13:23.135184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1668/3294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:23.172690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:23.180948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fe3e178d-7b42-493c-b765-877556cbfaf5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156731 Sep 06 12:13:23.181523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1627/3295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:23 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:23.722536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:23.723162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:23.729327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:23.729849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:23.730295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:23.730985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:23.731445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:23.731873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:23.863537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:23.871800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc46512e-25f1-4ab3-acbc-b807e7288189 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153680 Sep 06 12:13:23.872358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1669/3296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:23.991813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:23.992464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:23.999019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:23.999505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:23.999940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.000756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.001214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.001638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.004872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:24.005522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:24.011896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.012184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.012536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.013226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.013761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.014135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.143963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:24.154756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15ec7029-020a-4306-822f-43869c1b1764 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166734 Sep 06 12:13:24.155437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1628/3297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:24.157896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:24.161404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:24.162052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:24.168080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:24.168607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.169092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.169554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:24.169742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.170621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.170772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-22328545-583e-463a-a965-b2ae1e326830 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.170387 Sep 06 12:13:24.171078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.173684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.173850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1670/3298] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:24.207755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:24.208383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:24.215071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.215560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.215998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.216701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.217159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.217588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.310734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:24.320750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c86ad16d-0e6b-44c8-832e-4fbff98a41e4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164159 Sep 06 12:13:24.321334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1629/3299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:24.357107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:24.365730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-35ffe46d-ae84-4c75-8eb3-b8fa391579c3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162966 Sep 06 12:13:24.366310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1671/3300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:24.895598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:24.896212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:24.902404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.902886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.903314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:24.904018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:24.904464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:24.904885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.034084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.042346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4170be22-74d4-49f2-92b0-4f22035e5166 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.150744 Sep 06 12:13:25.042919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1630/3301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:25.179282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:25.179888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:25.186499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.186976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.187695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.188958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.189168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.189524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.196536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:25.197289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:25.203327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.204686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.204843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.205507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.205998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.206423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.322169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.330698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f111768a-c03d-4067-b571-a2ce1bba835e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155256 Sep 06 12:13:25.331330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1672/3302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:25.341501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.345223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:25.345935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:25.351657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.351873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.352329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.352762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.353202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.353447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.353941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.354370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.354493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c59a2574-da9d-4006-b472-6c3cae443a63 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161920 Sep 06 12:13:25.354935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1631/3303] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:25.390184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:25.390791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:25.398553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.399129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.399641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.400443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:25.400975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:25.401755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:25.493877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.502517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e9525e3b-2b60-4d0c-b29d-cfbad80bcf36 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161743 Sep 06 12:13:25.503074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1673/3304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:25.550268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:25.558662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32b3fc9c-4898-4c3d-bbe1-53c49a3abe5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.172190 Sep 06 12:13:25.559232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1632/3305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:25 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:26.066212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:26.066730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:26.072701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.073181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.073612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.074322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.074796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.075219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.206333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.214563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4ff8d9e2-185c-485a-92a1-34769bc25276 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152883 Sep 06 12:13:26.215133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1674/3306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:26.355204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:26.355792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:26.362353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.362859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.363277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.363973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.364424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.364852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.384836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:26.385463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:26.391567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.392544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.392993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.393813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.394261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.394687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.498550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.508380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2fa67b58-6455-4f01-94a0-3888c15201e7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156976 Sep 06 12:13:26.508913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1633/3307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:26.530338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.531081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:26.531705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:26.538339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.538821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.539248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.539858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.540005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.540372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.540789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.541312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.542518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-44d486b8-f0b4-4b7f-a4e5-0636347936de tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165869 Sep 06 12:13:26.543398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1675/3308] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:26.582744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:26.583524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:26.589929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.590502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.591015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.591786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:26.592320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:26.592850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:26.688392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.696959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a79eaed3-ebe7-4081-840e-e76041e47a90 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173865 Sep 06 12:13:26.697630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1634/3309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:26.731743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:26.734025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:26.741977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-728d60aa-1f90-4dc5-9db3-3b1bc7d11f4f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.163507 Sep 06 12:13:26.742557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1676/3310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:26 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:27.238434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:27.239055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:27.245125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.245613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.246080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.246772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.247226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.247652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.382403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.390659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-79827301-2d79-42a1-aa2c-92e57bdfe769 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156786 Sep 06 12:13:27.391232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1635/3311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:27.534016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:27.535263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:27.542061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.542553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.542988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.543690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.544294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.544686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.572393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:27.573005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:27.580269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.580922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.581042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.581743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.582195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.582613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.686768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.698266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8bdee2cb-d502-4d5b-82eb-f6e9b5b67530 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168211 Sep 06 12:13:27.698887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1677/3312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:27.720521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:27.721145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:27.727257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.727633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.728075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.728768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.729223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.729670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.734470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.744190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.745727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.746971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ee013e43-b428-4bc9-9329-4d50f45f5074 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.178455 Sep 06 12:13:27.747457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1636/3313] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:27.765528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:27.766301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:27.772965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.773442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.773898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.774588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:27.775037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:27.775457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:27.778411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:27.873664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.885262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cb9c39aa-d449-48d3-8ae5-f7c52041b91f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.168586 Sep 06 12:13:27.901463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1678/3314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:27.931884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:27.941488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34dc329a-3325-4db1-af87-244e4039640c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.179597 Sep 06 12:13:27.942112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1637/3315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:27 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:28.414910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:28.415677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.417595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:28.423269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.423976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.424460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.425192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.425676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.426142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.555510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:28.563981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6a46992-a631-45c7-8ed8-c03dc41f2cdf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152708 Sep 06 12:13:28.564565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1679/3316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:28.723238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:28.723845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.730306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.730793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.731229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.731920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.732373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.732808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.775744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:28.776510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.783096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.783588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.784033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.784729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.785188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.785616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.869293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:28.878102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f43d9215-e687-4d9b-a05a-11d16aaa8a4b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159231 Sep 06 12:13:28.878692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1638/3317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:28.908745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:28.909396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.915360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.915839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.916267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.916943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.917390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.917845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.922846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:28.932189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:28.934643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:28.935302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4b6086ab-ab9f-470c-81e5-db67c0f2ab0c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163445 Sep 06 12:13:28.936203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1680/3318] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:28.966863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:28.967648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:28.975529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.976024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.976470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:28.977229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:28.977713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:28.978179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.071729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:29.082916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-106c5dfd-1702-43ba-9937-40744dc7172d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.178032 Sep 06 12:13:29.098077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1639/3319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:29.147970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:29.156941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-904b3670-14c8-43d0-9d6d-bbb94a0da177 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.196471 Sep 06 12:13:29.158220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1681/3320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:29.588319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:29.588858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:29.595503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.595991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.596460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.597152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.597608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.598061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.729687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:29.738624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6c94919b-7b61-44b5-b67b-e52ecb98178e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154241 Sep 06 12:13:29.739190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1640/3321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:29.901973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:29.902544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:29.909395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.909896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.910353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.911037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.911567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.911900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.962720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:29.963334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:29.969447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.970660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.971321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:29.971714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:29.972174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:29.972600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.054713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.064712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d47fd2ff-1dd6-4669-bddc-2f6547b22ae6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166899 Sep 06 12:13:30.065298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1682/3322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:30.107685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:30.108319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:30.114688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.115184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.115622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.116090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.116321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.116779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.117206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.125172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.126724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.128081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c9725aa0-d77d-42df-8ec8-0bc76eb58473 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169304 Sep 06 12:13:30.128653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1641/3323] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:30.182113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:30.182733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:30.189698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.190220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.190660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.191379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.191837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.192270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.253748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.262510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2418394f-5bc2-452d-9a8b-e0a37dd715a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158677 Sep 06 12:13:30.263372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1683/3324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:30.325117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.334648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-042f910e-1bc3-4f60-92df-7fb56dbadb55 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156372 Sep 06 12:13:30.335224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1642/3325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:30.761750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:30.762368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:30.768879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.769357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.769826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.770510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:30.770966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:30.771391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:30.900134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:30.909690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fc79fa3a-d123-4ad8-a270-277b090a531f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151868 Sep 06 12:13:30.910344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1684/3326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:31.088391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:31.089011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:31.091380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:31.097171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.097885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.098298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.099072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.099605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.100107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.154292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:31.154905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:31.161041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.161520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.161992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.162699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.163124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.163542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.231387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:31.240502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8948fca4-a960-4196-9f7c-7ac79213d9e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155900 Sep 06 12:13:31.241188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1643/3327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:31.288845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:31.289463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:31.295481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.295973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.296407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.297095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.297547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.299289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.299863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:31.308710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:31.310191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:31.311372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-79a08bc1-a126-464c-9170-452a3463d18a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161350 Sep 06 12:13:31.311925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1685/3328] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:31.358078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:31.358827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:31.365758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.366245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.366682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.367379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.367834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.368261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.435600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:31.444553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c47d390a-07eb-45cd-8d77-efe253ed0267 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160051 Sep 06 12:13:31.445224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1644/3329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:31.499286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:31.507622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-49ceda7a-4534-47cc-810d-ff86f267d36e tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153409 Sep 06 12:13:31.508183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1686/3330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:31 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:31.933176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:31.933921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:31.940957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.941453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.941943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:31.942651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:31.943111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:31.943540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.072934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.081865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-68c9b98d-2c8e-4dd3-9b69-724f527dea45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152735 Sep 06 12:13:32.082450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1645/3331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:32.264378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:32.264981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:32.271589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.272071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.272499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.273180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.273628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.274080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.337606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:32.338397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:32.344904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.345524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.346006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.346782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.347238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.347666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.415369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.424429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b0d8659-4ced-4352-9136-c55c59d1544e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163785 Sep 06 12:13:32.424936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1687/3332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:32.468202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:32.468818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:32.476273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.476753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.477214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.477949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.478421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.478815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.484274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.493959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.495480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.496752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e226790-7291-4be8-808a-759dc0e734b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163064 Sep 06 12:13:32.497393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1646/3333] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:32.531522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:32.532052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:32.539064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.539554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.539997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.540723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:32.541183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:32.541610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:32.617792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.627071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0bdd8ef9-4fd8-454d-9967-4d47086c5710 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162153 Sep 06 12:13:32.627663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1688/3334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:32.673709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:32.681853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a3e1723-c1e8-4293-ac06-9580c0a8067d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154231 Sep 06 12:13:32.682425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1647/3335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:32 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:33.104370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:33.104984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:33.111179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.111661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.112098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.112788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.113247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.113807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.246261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.255580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-56ee0cff-ab0a-4608-80e7-92e917adc17e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155057 Sep 06 12:13:33.256160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1689/3336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:33.448998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:33.449621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:33.456985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.457473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.457943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.458639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.459090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.459518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.523867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:33.524489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:33.531182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.531667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.532113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.532926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.533487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.533947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.597793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.607232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-539db8dd-7477-4032-b4ac-9c6e304f1e85 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162045 Sep 06 12:13:33.607833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1648/3337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:33.650139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:33.650896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:33.657132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.657793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.658237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.658963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.659607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.660277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.675989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.684610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.686078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.687289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bbac73fa-733e-4cf7-8cd6-a5f6630d2d15 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167352 Sep 06 12:13:33.687817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1690/3338] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:33.704904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:33.706822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:33.713148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.713637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.714135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.714832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:33.715319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:33.715744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:33.809822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.820059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-076801fa-b767-4876-91b8-72a0c765a6d1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173727 Sep 06 12:13:33.820651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1649/3339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:33.877548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:33.886744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7c22932-f775-4d5c-a75e-63f88213b023 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.186023 Sep 06 12:13:33.887338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1691/3340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:33 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:34.279533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:34.280146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:34.287538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.288037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.288479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.289197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.289768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.290201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.436369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:34.445065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ce1e7a6e-da43-4f42-b9d0-969b7276d6b3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.169597 Sep 06 12:13:34.445666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1650/3341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:34.630864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:34.631427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:34.638012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.638492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.638924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.639605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.640052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.640470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.715633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:34.716332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:34.723596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.724166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.724668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.725426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.725997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.726482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.782881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:34.791021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9165e895-15e7-466d-9447-e1c7d87e915b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164041 Sep 06 12:13:34.791611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1692/3342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:34.844206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:34.845133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:34.851230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.851719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.852153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.852845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.853298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.853747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.865098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:34.868909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:34.875102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:34.877214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:34.879319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-658afb27-4aa5-4129-99d0-47ab5163e2f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167722 Sep 06 12:13:34.879938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1651/3343] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:34.911710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:34.912322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:34.918375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.918853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.919283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.919962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:34.920413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:34.920832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:34.999248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:35.008357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef24a5e4-7c96-434c-92d6-bb8367ab4f7b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167992 Sep 06 12:13:35.008937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1693/3344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:35.054339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:35.062686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9148e2ee-a6f0-4148-ba21-828fdc6829e1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154782 Sep 06 12:13:35.063265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1652/3345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:35.468799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:35.469458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:35.476024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.476503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.476935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.477609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.478096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.478520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.612134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:35.620391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-504e0572-f091-4131-a919-7da1060ea1c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155447 Sep 06 12:13:35.621018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1694/3346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:35.815923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:35.816430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:35.822770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.823256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.823688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.824377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.824828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.825250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.904888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:35.905489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:35.913171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.913690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.914141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.914846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:35.915307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:35.915938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:35.962059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:35.964199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:35.971628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04da31ac-c0e1-422b-a0fd-d81359b6f09b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160626 Sep 06 12:13:35.972125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1653/3347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:36.032704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:36.033441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:36.039196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:36.039678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:36.040111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:36.040793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:36.041237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:36.041662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:36.050436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:36.059107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:36.060560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:36.061779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b8e75cca-b119-47f6-b933-1bdb7722ac19 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161149 Sep 06 12:13:36.062371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1695/3348] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:36.086365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:36.086895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:36.092920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:36.093410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:36.093878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:36.094621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:36.095873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:36.096374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:36.174351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:36.182744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-98fa9fdf-d929-4b33-87f5-43731b78dab1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154646 Sep 06 12:13:36.183328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1654/3349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:36.227711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:36.236489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-da0aee06-4dd3-442c-a4f5-e187043acf20 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153927 Sep 06 12:13:36.237065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1696/3350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:36 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:36.644451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:36.644939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:36.651426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:36.651911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:36.652349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:36.653053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:36.653509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:36.653984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:36.780193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:36.788469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66df246f-709f-47e5-892a-ae1a458e3f83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.148712 Sep 06 12:13:36.789042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1655/3351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:36.995243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:36.995855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:37.003033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.003507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.003939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.004625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.005136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.005558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.087869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:37.088485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:37.095982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.096489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.096929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.097627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.098245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.098676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.140669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.148976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cf515077-783c-4f59-8d84-82ba7840ede5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157502 Sep 06 12:13:37.149561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1697/3352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:37.206715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:37.207375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:37.213335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.213870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.214310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.215010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.215463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.215887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.236860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.249861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.249861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.249861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-519e97df-ea6f-48b3-93ef-53425e70e040 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164362 Sep 06 12:13:37.250264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1656/3353] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:37.261450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:37.264844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:37.271620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.272112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.272542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.273245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.273729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.274177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.351303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.359872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c27149a4-4bbd-4222-a369-5b45de65ca7f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157592 Sep 06 12:13:37.360537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1698/3354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:37.408725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.417251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a13b667f-5cc5-404a-889b-06a9e4f24a43 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160492 Sep 06 12:13:37.417905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1657/3355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:37 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:37.812488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:37.813054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:37.819248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.819739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.820177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.820870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:37.821332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:37.821800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:37.957978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:37.966231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-62f2a540-0b4a-478f-a0b3-7971c9ccc91d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157742 Sep 06 12:13:37.966801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1699/3356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:38.174611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:38.175231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:38.181630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.182144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.182588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.183282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.183744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.184170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.275562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:38.276422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:38.283957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.284456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.284891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.285598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.286081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.286509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.322600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:38.331722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0fdce6dc-f1ae-426a-ba39-72eab32f4155 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161162 Sep 06 12:13:38.332306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1658/3357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:38.383181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:38.383789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:38.389787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.390267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.390700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.391867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.392740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.392891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.420914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:38.429338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:38.430734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:38.431901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9fd4e107-a689-433b-afab-8d16bd0ca30b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160247 Sep 06 12:13:38.432451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1700/3358] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:38.440829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:38.441592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:38.447753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.448348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.448883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.449682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.450235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.450751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.538144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:38.547203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ad495130-f9c3-4d0b-b597-f1f7f22c9183 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167726 Sep 06 12:13:38.547854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1659/3359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:38.595447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:38.604831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0dc6f4a6-18a0-4585-a144-58b66ae87ef4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.167827 Sep 06 12:13:38.605406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1701/3360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:38.990941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:38.991551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:38.997662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.998168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:38.998598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:38.999274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:38.999719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.000148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.135628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.144095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cacc8cad-e1bf-4976-b045-00457daf5dc6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156971 Sep 06 12:13:39.144830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1660/3361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:39.355706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:39.356261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:39.363467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.363944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.364369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.365043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.365489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.365934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.458919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:39.459705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:39.466008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.466499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.466942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.467650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.468107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.468540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.611805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.621920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.623978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.625298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-11f79354-f591-4699-a492-70ae1cb5d864 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.170359 Sep 06 12:13:39.626295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1661/3362] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:39.631318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:39.632244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:39.638996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.639491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.639916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.640624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.641070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.642133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.782729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.791351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c9460a59-8fc7-4bd0-9d19-a53c28b77040 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163659 Sep 06 12:13:39.791933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1662/3363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:39.796536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:39.797140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:39.803150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.803627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.804057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.804744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:39.805190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:39.805611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:39.904142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.914719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-905a677e-ac2e-42b0-bf4f-7f43bab134d4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.562911 Sep 06 12:13:39.915297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1702/3364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:39.943452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:39.951534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bcf6fda3-e331-4060-8f55-f32e8a2301c4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158567 Sep 06 12:13:39.952105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1663/3365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:39 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:40.170113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:40.170753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:40.177525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.178048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.178491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.179185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.179648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.180076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.316880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:40.325195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a240447-d994-41d5-8d9c-357e6163631a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158905 Sep 06 12:13:40.325781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1703/3366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:40.653320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:40.653965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:40.661059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.661540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.662091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.662772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.663217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.663635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.795284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:40.803792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:40.805228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:40.806409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-febdaf76-eeaa-4277-a948-e3906ee6a16f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157394 Sep 06 12:13:40.806965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1664/3367] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:40.815477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:40.816092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:40.822801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.823284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.823716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.824406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.824860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.825286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.939602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:40.940308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:40.946569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.947061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.947501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.948196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.948654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.949085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.961218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:40.970693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4dddd12f-28d6-40ba-9bfb-61c8e229a15d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159085 Sep 06 12:13:40.971278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1704/3368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:40.975844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:40.976888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:40.982513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.982998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.983648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:40.984339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:40.984794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:40.985320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:41.086487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:41.095527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-78b5b98e-aad5-418f-94ad-1249fd4ad29c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160234 Sep 06 12:13:41.096122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1665/3369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:41.119551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:41.128461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8369fe1a-5f80-484e-a0e1-ffa44f6ded32 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156219 Sep 06 12:13:41.129056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1705/3370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:40 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:41.349478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:41.350118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:41.356132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:41.356617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:41.357053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:41.357802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:41.358283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:41.358717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:41.489723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:41.497829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc3af0aa-7b9b-4642-a1f6-6e6314d23d77 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152268 Sep 06 12:13:41.498392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1666/3371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:41.832559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:41.833107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:41.839782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:41.840256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:41.840688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:41.841369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:41.841846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:41.842267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:41.977564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:41.986327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:41.987784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:41.989005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ddd88563-f738-43a9-9e9d-71cae1fb1e8e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160427 Sep 06 12:13:41.989586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1706/3372] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:41.994902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:41.995515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:42.001949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.002426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.002855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.003540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.003989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.004410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.119328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:42.119860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:42.125834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.126323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.126754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.127438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.127997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.128552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.132345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:42.140599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b8f5bf0-da39-4374-a8b2-4d8c9e250847 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.149460 Sep 06 12:13:42.141205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1667/3373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:42.152751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:42.153357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:42.159943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.160618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.161058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.161788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.162244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.162684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.265380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:42.274272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50916552-fade-4922-a59d-3000f0338e08 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158612 Sep 06 12:13:42.274860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1707/3374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:42.512921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:42.521611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:42.521966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f86ce91e-4d16-49d9-90d9-6984234ca8d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.373152 Sep 06 12:13:42.522266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:42.522565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1668/3375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:42 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:42.528700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.529212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.529662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.530384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:42.530836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:42.531253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:42.664478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:42.672774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ac060ab2-82b8-44f9-bf0a-039309cd9573 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155731 Sep 06 12:13:42.673341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1708/3376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:43.015171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:43.015770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:43.022715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.023200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.023646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.024421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.024872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.025307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.157851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.165068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:43.165729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:43.167301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.168782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.169971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0c751cca-7c1e-4090-97f7-585c4022f0e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158878 Sep 06 12:13:43.170529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1669/3377] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:43.172103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.172589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.173028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.173749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.174216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.175242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.298806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:43.299373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:43.305362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.305895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.306338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.307044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.307500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.307931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.308572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.317566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8f67a136-5c64-4679-a8ef-9f2b9d981df0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156260 Sep 06 12:13:43.318175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1709/3378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:43.323542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:43.443120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.451355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-67c1b611-e53c-45f4-8460-be25d4cd3d27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156481 Sep 06 12:13:43.451927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1670/3379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:43.545417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:43.546075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:43.553290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.553811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.554412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.555468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.556161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.556803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.562881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:43.697207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:43.697927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:43.702953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.703989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.704487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.704924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.705620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:43.706107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:43.706543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:43.711534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fab40000-0ebb-4b90-b19d-14054ce18caa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170036 Sep 06 12:13:43.712107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1710/3380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:43 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:43.836596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:43.844883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-30cd1fa2-ee49-42bc-8875-3f40a79a8cb6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151531 Sep 06 12:13:43.852608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1671/3381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:44.197431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:44.198068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:44.204849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.205367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.206600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.207355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.207780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.208330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.341834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:44.342457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:44.342896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:44.349590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.350106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.350550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.352126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.352432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:44.352699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.353359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.353915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:44.355408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c7c19861-ea34-4936-a820-eae9d6523e38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162251 Sep 06 12:13:44.355959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1711/3382] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:44.475473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:44.476151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:44.482742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.483233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.483667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.484364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.484821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.485244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.497569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:44.506323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-275b76d0-4ce9-4add-95d2-94d82677030a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.168659 Sep 06 12:13:44.506901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1672/3383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:44.616747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:44.624995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1870d0f1-5922-4521-9c2c-311dc5961800 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154793 Sep 06 12:13:44.625562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1712/3384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:44.734933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:44.735468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:44.742160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.742676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.743103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.743777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.744224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.744644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.869544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:44.869934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:44.872065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:44.877360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.878437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.878437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.879478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:44.879478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:44.879835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:44.883343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20a90779-21bf-4655-b323-45ec7f6de29f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151875 Sep 06 12:13:44.885122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1673/3385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:44 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:45.016185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:45.024868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ce33e84-aa4c-4f09-9bd8-e10390a1b38f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159630 Sep 06 12:13:45.025431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1713/3386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:45.382482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:45.383043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:45.389410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.389953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.390389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.391071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.391525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.391946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.524974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:45.530429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:45.531032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:45.534614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:45.536073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:45.537249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba0bc51e-28ff-4a8a-a865-03580498e620 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159548 Sep 06 12:13:45.537864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1674/3387] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:45.538045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.538549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.538987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.539691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.540148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.540576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.649009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:45.649541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:45.656145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.656640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.657076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.657816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.658283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.659281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.672428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:45.681920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e9c7577-f791-4bfd-9efe-1fa8149659a3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155503 Sep 06 12:13:45.682503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1714/3388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:45.793575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:45.803941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f8556bf6-9b55-4663-96a5-831d93b57c7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158865 Sep 06 12:13:45.804524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1675/3389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:45.907060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:45.907693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:45.914267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.914758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.915225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:45.915920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:45.916380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:45.916807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.048662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:46.049283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:46.055523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.056012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.056213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.056451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.057180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.057691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.058114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.064570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a99e144d-cf45-4f56-bd59-252b37589165 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161487 Sep 06 12:13:46.065287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1715/3390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:45 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:46.190221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.198778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c9d48e2c-1646-4939-9530-e1e22c148843 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154286 Sep 06 12:13:46.199356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1676/3391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:46.564011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:46.564614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:46.571058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.571538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.571969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.572655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.573108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.573531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.704703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:46.705348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:46.712556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.713049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.713487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.714213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.714670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.715100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.723162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.731966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.733459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.734739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-054414fb-11e7-464e-8b08-5fc84201a1b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.174656 Sep 06 12:13:46.735298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1716/3392] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:46.827695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:46.828313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:46.835103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.835587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.836023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.836713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:46.837167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:46.837591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:46.862298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.871435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f5e11f5-81f7-4fff-8f02-abb740eaf0eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.170498 Sep 06 12:13:46.872020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1677/3393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:46.970110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:46.979303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41324762-ea25-45d8-9500-bd0a57441a05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155499 Sep 06 12:13:46.979872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1717/3394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:47.088213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:47.088745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:47.094815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.095287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.095743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.097033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.097482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.097926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.223688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:47.224406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:47.230141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:47.230897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.231396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.231841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.232555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.233025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.233454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.238508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-16e6589c-4118-4a99-a7b7-7d6ea9ec6a13 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154169 Sep 06 12:13:47.239087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1678/3395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:47 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:47.368976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:47.378216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee05d08f-3e1a-4d8a-8f32-ae86695f2b06 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157909 Sep 06 12:13:47.378928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1718/3396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:47.760320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:47.760925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:47.767626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.768106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.768544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.769948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.770413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.770838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.894836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:47.895595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:47.902309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.902844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.903227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.903929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:47.904387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:47.904848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:47.905477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:47.914732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:47.916184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:47.917361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7beecf1b-b787-4226-9be7-945f60e034f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160947 Sep 06 12:13:47.917953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1679/3397] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:48.003515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:48.004134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:48.011353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.011755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.012181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.012875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.013348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.013800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.043472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:48.052707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-873511a7-dcd7-407a-aea6-7825c238cada tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161954 Sep 06 12:13:48.053290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1719/3398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:48.147351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:48.156123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04d7c365-e961-4bc7-ac4b-65ce08dcaebe tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156436 Sep 06 12:13:48.156736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1680/3399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:48.262583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:48.263252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:48.269405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.270696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.271236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.272044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.272568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.273064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.403684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:48.404240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:48.411444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.412147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.412661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.413446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.413989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:48.414132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.414581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.422331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8fde40a9-0912-46df-a348-b8bd7c78d02d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.163754 Sep 06 12:13:48.422910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1720/3400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:48 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:48.545080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:48.554072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a0a07335-8595-4035-92d6-6ee68a28558c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155389 Sep 06 12:13:48.554649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1681/3401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:48.947721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:48.948330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:48.954952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.955439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.955874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:48.957106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:48.957568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:48.958030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.076585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:49.077297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:49.083917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.084485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.084993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.085815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.086282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.086817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.090914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.100597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.102559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.103951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a600881f-cedd-49ef-80b6-ddc6ce637af0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160126 Sep 06 12:13:49.104796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1721/3402] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:49.179587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:49.180220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:49.186663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.187162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.187602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.188306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.188959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.189243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.229443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.237858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f07f871-a454-4c0f-b655-ef1022a12e28 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165081 Sep 06 12:13:49.238495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1682/3403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:49.323783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.333296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7734c0b-0b27-4519-b130-77fc8842c942 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157115 Sep 06 12:13:49.333902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1722/3404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:49.447930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:49.448536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:49.454648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.455120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.455544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.456216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.456699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.457116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.576981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:49.577731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:49.584150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.587370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.587661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.587863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.588608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:49.589083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:49.589521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:49.597925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b3477d45-0ed8-4d41-998c-d661eb8351de tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153711 Sep 06 12:13:49.598510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1683/3405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:49 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:49.725521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:49.733693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc6a0b2f-52cf-41dc-8dff-1caa3ff478af tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161124 Sep 06 12:13:49.734258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1723/3406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:50.130202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:50.130781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:50.137090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.137564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.138029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.138715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.139159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.139675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.261803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:50.262744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:50.269830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.270448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.270946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.271707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.272227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.272772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.279310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.289492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.291029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.292348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b74874ff-5c39-43ff-add1-65180f6bc9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166597 Sep 06 12:13:50.292917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1684/3407] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:50.360089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:50.360767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:50.366974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.367667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.368114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.369299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.369856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.370295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.409275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.418466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-352fdee4-60b5-447f-86d0-bf0c374f3a51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160617 Sep 06 12:13:50.419192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1724/3408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:50.500610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.509376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e9094481-bbf6-4ccf-b251-77aeb9af8fd7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.153169 Sep 06 12:13:50.509979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1685/3409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:50.622081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:50.622698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:50.629229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.629742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.630184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.630871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.631329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.631755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.759494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:50.760114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:50.765886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.766446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.767009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.767552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.768309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:50.768902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:50.770090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:50.774932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb1dec7d-71ab-4fad-9071-cea74ce26660 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156680 Sep 06 12:13:50.775615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1725/3410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:50 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:50.898541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:50.906959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e15839b-92f6-4506-911c-bdddcd780341 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151365 Sep 06 12:13:50.907529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1686/3411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:51.318353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:51.318965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:51.325468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.325992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.326433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.327122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.327581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.328007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.442175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:51.442849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:51.449406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.449916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.450351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.451041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.451493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.451911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.454529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:51.468020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:51.470282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:51.478822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:51.480258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:51.481427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5c1cb38-8084-4a1d-be07-0f1cf3ecd37a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167522 Sep 06 12:13:51.482026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1726/3412] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:51.533728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:51.534112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:51.540748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.541245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.541722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.542415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.542877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.543309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.589187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:51.597449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0796d11d-d31b-4147-a323-d666caec1687 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159425 Sep 06 12:13:51.598233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1687/3413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:51.677015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:51.685363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e84e0fe2-f0f4-4eef-8198-3ad3e8960cc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155767 Sep 06 12:13:51.685969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1727/3414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:51.798511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:51.799040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:51.805424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.805928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.806358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.807029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.807477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.807891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.931207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:51.931853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:51.938275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.938659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.939105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.939818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:51.940286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:51.940441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:51.940726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:51.949332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-39a13f16-bdf3-4f0e-ba2f-b632864009d1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154631 Sep 06 12:13:51.949946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1688/3415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:51 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:52.079200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:52.087460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f3219a35-b213-4684-b518-9ed1434dfa0e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160101 Sep 06 12:13:52.088026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1728/3416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:52.507961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:52.508578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:52.515088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.515572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.516009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.516720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.517176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.517602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.621903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:52.622548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:52.624877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:52.630989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.631487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.631930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.632637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.633121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.633552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.656316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:52.665661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:52.667125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:52.668302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c1379aff-6bee-4cda-b953-64f1d7fa3196 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164535 Sep 06 12:13:52.677734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1689/3417] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:52.710060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:52.710673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:52.716783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.717269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.717732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.718425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.718880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.719304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.767928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:52.777058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c383d719-1553-4b35-9dae-b144419d25fb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159133 Sep 06 12:13:52.777633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1729/3418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:52.850273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:52.858546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4719940b-6d87-43d4-ab90-b16a73519aaa tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.153086 Sep 06 12:13:52.859051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1690/3419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:52.972711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:52.973331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:52.979386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.979874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.980321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:52.981160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:52.981456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:52.981915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.111117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:53.111650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:53.116782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:53.118709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.119687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.119687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.120312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.120764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.121187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.125296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eeea47bb-2f10-462f-9ab4-26c900986a41 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156499 Sep 06 12:13:53.125913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1730/3420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:52 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:53.255123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:53.263452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5b2d2521-0557-48a4-9ef7-246df6d0bbe9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156271 Sep 06 12:13:53.264039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1691/3421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:53.694799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:53.695452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:53.702029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.702518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.702957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.703646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.704103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.704528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.801069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:53.801831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:53.808377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.808943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.809457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.810257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.810819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.811317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.834896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:53.843795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:53.845263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:53.846477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe8842fd-0d20-47be-8a86-276d32a39f4e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.155771 Sep 06 12:13:53.847049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1731/3422] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:53.881766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:53.882395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:53.888435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.888927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.889567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.890714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:53.890714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:53.891033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:53.947630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:53.957450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0a9ba63c-7e47-4d75-ba32-97e4f1f954de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160215 Sep 06 12:13:53.958235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1692/3423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:54.027925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:54.037251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4ff8ffa0-4d60-4f29-ab2b-8bb269dd809d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159555 Sep 06 12:13:54.037882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1732/3424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:54.150019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:54.150653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:54.152684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:54.158172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.158658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.159148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.160315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.160784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.161210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.289490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:54.290169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:54.296232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.296591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:54.296747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.297234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.297885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.298342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.298765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.306285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-da782fee-6c4d-49b5-a2cb-d0593f5de4f4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160026 Sep 06 12:13:54.306880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1693/3425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:54 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:54.434363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:54.443962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-06ab7d7d-8cf4-4cfe-b4ef-4aa985c02832 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159674 Sep 06 12:13:54.444543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1733/3426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:54.872694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:54.873267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:54.880282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.880763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.881204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.881939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.882393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.882820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.981519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:54.982158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:54.989320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.989833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.990272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:54.990963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:54.991420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:54.991834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.020051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.029233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.030721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.031910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac4c6d95-d225-4236-ae55-b83013a10244 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163243 Sep 06 12:13:55.032484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1694/3427] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:55.060246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:55.060945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:55.067254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:55.067734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:55.068163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.068853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:55.069305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:55.070138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.122584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.131296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0cd05fde-944c-4cb1-b323-2c97bcb59a4d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.153486 Sep 06 12:13:55.131797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1734/3428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:55.200083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.208199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-73588e5d-602a-47b0-8a86-d0dd4b6efa69 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.151762 Sep 06 12:13:55.208758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1695/3429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:55.329993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:55.330615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:55.337103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:55.337594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:55.338071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.338766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:55.339224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:55.339654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.467632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:55.468349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:55.475476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:55.475962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:55.476391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.476514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.477079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:55.477526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:55.477971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:55.485247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6d8a28f3-5295-485f-865c-35ac05145b30 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159155 Sep 06 12:13:55.485957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1735/3430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:55 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:55.613750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:55.623855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-70da5b10-1000-4afe-8baa-9ae66dd27c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160089 Sep 06 12:13:55.625275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1696/3431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:56.057340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:56.057970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:56.059956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:13:56.060177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 (ip 10.222.0.18) !!! Sep 06 12:13:56.061512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:13:56.061637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 (ip 10.222.0.18) !!! Sep 06 12:13:56.075361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.075853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.076328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.077034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.077494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.077956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.154808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:56.155426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:56.162217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.162716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.163159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.163871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.164330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.164760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.213683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.222899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.224413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.225629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e008bb2a-0735-4766-9787-efa9d23b1688 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.172311 Sep 06 12:13:56.226376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1736/3432] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:56.231480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:56.232753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:56.241635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.242513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.243205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.244122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.244577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.245041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.309026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.317808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-54f55a8d-3943-40ad-b09a-92bc3a9e915b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167000 Sep 06 12:13:56.318402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1697/3433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:56.383410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.391622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f18dd242-c715-4119-8683-c94e2721a35e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163728 Sep 06 12:13:56.392195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1737/3434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:56.508956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:56.509486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:56.515477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.515961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.516403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.517090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.517542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.517995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.650029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:56.650661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:56.654509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.656944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.657463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.657938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.658648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:56.659108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:56.660158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:56.663414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8277fa82-67a2-4708-9a2c-56773a3449f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158427 Sep 06 12:13:56.664181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1698/3435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:56 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:56.789535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:56.797803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-635edae2-2576-43cf-b06b-b9d3103bedf3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152007 Sep 06 12:13:56.798376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1738/3436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:57.252290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:57.252904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:57.260035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.260513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.260973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.261674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.262148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.262567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.341030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:57.341772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:57.348485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.348973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.349411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.350446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.350833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.351289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.407352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.416541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.418054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.419569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ef620f1-38d3-4c8b-9df8-fc388d07e585 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171233 Sep 06 12:13:57.420155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1699/3437] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:57.426128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:57.426470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:57.432927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.433412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.433878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.434600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.435009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.435441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.495223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.504864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34e3db8e-8b8d-4ac3-aef1-8ff524dc74c2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167541 Sep 06 12:13:57.505423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1739/3438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:57.572425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.580937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c9d85719-b89f-43b9-b2c6-b3e3ba6e9d77 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159813 Sep 06 12:13:57.582197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1700/3439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:57.686567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:57.687188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:57.694431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.694923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.695366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.696064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.696519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.696947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.822176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:57.822896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:57.828747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.829361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.829854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.830007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.830543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:57.830992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:57.831420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:57.838756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-317e482c-35c6-4b8e-8210-0a34c6a02871 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156021 Sep 06 12:13:57.839341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1740/3440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:57 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:57.964295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:57.973401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a70d63ba-2faa-4fb8-856f-f0584165a9aa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154637 Sep 06 12:13:57.974022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1701/3441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:58.444637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:58.445248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:58.451290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.451772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.452204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.452885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.453339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.453801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.528760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:58.529354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:58.536734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.537216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.537663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.538377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.538828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.539257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.588179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:58.597622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:58.599189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:58.600398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-52e7a4e1-aac6-4b12-9742-87a1ba3dabca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159804 Sep 06 12:13:58.601272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1741/3442] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:13:58.605617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:58.606261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:58.612404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.612949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.613492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.614424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.614881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.615310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.675982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:58.686222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4644bd4d-8d66-4a34-8214-a4d1b8c804b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161639 Sep 06 12:13:58.686994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1702/3443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:58.751722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:58.760609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-63722c62-6337-446a-ab9d-58fa3963af38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158518 Sep 06 12:13:58.761167 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1742/3444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:58.861884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:58.862435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:58.868624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.869113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.869554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:58.870277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:58.870741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:58.871167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.000708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:59.001463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:59.005930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.008169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:59.008514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.009047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.009738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.010433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.011144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.011342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.015217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2795613f-5abe-47b3-981b-3382994c6208 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157302 Sep 06 12:13:59.015791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1703/3445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:58 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:13:59.033668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:59.153002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.161614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3eaddd5-2e76-4914-b3e9-ebf9c18c8936 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164863 Sep 06 12:13:59.162206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1743/3446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:59.627060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:59.627670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:59.634375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.634950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.639488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.639488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.639488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.639488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.709899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:59.710512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:59.717104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.717587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.718043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.718726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.719174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.719592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.771673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.782843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.783614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.786444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e39cda3-a3ce-4768-b23d-bb98056a874e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161971 Sep 06 12:13:59.786444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1704/3447] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:13:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:13:59.791022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:13:59.791692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:13:59.797541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.798064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.798505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.808242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:13:59.808802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:13:59.809477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:13:59.861350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.870424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe69bba9-522e-4fc5-87dd-02e1653ccd86 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164778 Sep 06 12:13:59.871113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1744/3448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:13:59.943909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:13:59.952041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e52e823c-8684-4a45-a050-f84d1be34d6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164612 Sep 06 12:13:59.952613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1705/3449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:13:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:00.040893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:00.041505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:00.047423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.047898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.048327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.049034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.049481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.049929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.180233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:00.184378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:00.185000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:00.188523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2b32f093-c961-4dc2-9197-8b49eb12f010 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151463 Sep 06 12:14:00.189104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1745/3450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:00 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:00.191468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.191947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.192388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.193097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.193550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.194006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.328438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:00.336771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2384e7d3-9f4b-4397-9149-039e81cc7a70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156161 Sep 06 12:14:00.337341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1706/3451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:00.810791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:00.811446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:00.818102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.818394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.818836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.819532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.819987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.820417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.893477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:00.894674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:00.897122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:14:00.897271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:14:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 (ip 10.222.0.18) !!! Sep 06 12:14:00.905096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.905607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.906055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.906761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.907221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.907652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.954600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:00.964155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:00.965621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:00.966833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-52264230-2c2d-4a15-b8f7-17fd6b2483eb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160008 Sep 06 12:14:00.967402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1746/3452] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:00.976040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:00.976749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:00.982900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.983465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.983983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:00.984776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:00.985311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:00.985847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.042241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:01.051551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a0d3729-a067-4f7e-b352-584f9f905e15 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161831 Sep 06 12:14:01.052236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1707/3453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:01.123208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:01.132487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f31449f2-c577-42ba-bc71-4c1a710fabe3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160599 Sep 06 12:14:01.133055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1747/3454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:01.213574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:01.214217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:01.220264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:01.220746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:01.221177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.221953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:01.223019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:01.223447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.354645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:01.360274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:01.360896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:01.363359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a7d3743-fdf2-42b1-a11a-d635646edf24 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.153139 Sep 06 12:14:01.363936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1708/3455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:01 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:01.367801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:01.368285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:01.368748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.369446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:01.369930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:01.370362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:01.499543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:01.508375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8889d4f8-5508-4a4f-9f11-7513d9d0943c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152008 Sep 06 12:14:01.508962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1748/3456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:01.995011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:01.995665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:02.002130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.002617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.003335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.003930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.004385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.004813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.076134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:02.076875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:02.084192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.084716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.085161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.085888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.086346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.086807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.137230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.146425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.147873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.149068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c149aaf-b11b-4848-882c-85a42e70c03b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158113 Sep 06 12:14:02.149633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1709/3457] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:02.156471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:02.157245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:02.164865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.165347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.165814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.166512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.166999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.167622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.224266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.232626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ba5f37e9-ed80-4a3e-acb6-4d3f99de013e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160383 Sep 06 12:14:02.233216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1749/3458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:02.299431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.308885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52d0af32-dec4-4af4-bc6e-a716272c9457 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155995 Sep 06 12:14:02.309475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1710/3459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:02.387086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:02.387617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:02.393570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.395086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.395269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.395954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.396404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.396824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.526564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.531820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:02.532433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:02.535504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d22e0688-1243-48a9-8bde-ebed64bbdb5f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151963 Sep 06 12:14:02.536097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1750/3460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:02 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:02.538622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.539109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.539543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.540236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:02.540690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:02.541115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:02.675258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:02.683453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7aa53325-fd28-4458-b6e7-d1dac050fd97 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155435 Sep 06 12:14:02.684024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1711/3461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:03.177005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:03.177605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:03.184057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.184533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.184963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.185636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.186112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.186532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.256529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:03.257234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:03.263916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.264399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.265057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.265523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.266007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.266438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.320505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.329443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.331058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.332252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9428d95-ecd9-4f0c-ad3e-0c516de60a90 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159786 Sep 06 12:14:03.332828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1751/3462] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:03.350267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:03.351128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:03.357277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.357809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.358384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.359283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.359747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.360177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.398626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.407093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d602400d-f96d-464c-a57c-40647e16a53f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154447 Sep 06 12:14:03.407673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1712/3463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:03.496143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.504586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c918241a-349a-4bff-a211-fc7a9c267c23 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.170714 Sep 06 12:14:03.505099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1752/3464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:03.558514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:03.559405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:03.565374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.566152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.566694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.567394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.567841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.568261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.701449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.707808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:03.708517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:03.710192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c009b10-cfb5-4223-819f-0410b17112d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155521 Sep 06 12:14:03.710769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1713/3465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:03 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:03.714658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.715145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.715587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.716290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:03.716749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:03.717180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:03.847611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:03.856857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c99f3ba-721f-4f58-9d9b-d979709f02dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153674 Sep 06 12:14:03.857432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1753/3466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:04.357876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:04.358534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:04.366053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.366530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.366983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.367685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.368132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.368550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.431542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:04.432287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:04.438941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.439515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.440057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.441499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.441982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.442411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.510085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.518899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.520946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.522742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8b463515-7e18-490b-a0c5-0ae522ed100e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168678 Sep 06 12:14:04.522991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1714/3467] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:04.542243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:04.542850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:04.549197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.549704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.550619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.551326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.551783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.552201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.580032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.588429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0dbed9f0-c42f-4592-b441-dcf49c1e77aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160713 Sep 06 12:14:04.589011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1754/3468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:04.691187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.699607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-562888c2-9965-4630-aec7-dc22fdcd4411 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161151 Sep 06 12:14:04.700188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1715/3469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:04.733823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:04.734469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:04.741446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.741952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.742384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.743065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.743521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.743942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.873476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:04.881232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:04.881985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1be9e0e6-38ea-460a-8613-36efed60ede3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.151968 Sep 06 12:14:04.882134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:04.882577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1755/3470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:04 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:04.888165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.888719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.889224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:04.890014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:04.890470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:04.890895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.021254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.029787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-44c00dd0-ef72-4764-8420-46ea66ea7641 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152560 Sep 06 12:14:05.030357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1716/3471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:05.547840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:05.548454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:05.554944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.555428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.555867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.556587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.557047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.557473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.612163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:05.613113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:05.620328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.620956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.621404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.622188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.622651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.623083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.692094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.700882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.702371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.703961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d66a52b7-2765-4afe-baac-1f8cee24a9fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159709 Sep 06 12:14:05.710475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1756/3472] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:05.722834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:05.723587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:05.729635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.730247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.730691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.731391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.731851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.732281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.758771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.771691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-771a69d7-078a-4892-b0dd-c9077266811c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163529 Sep 06 12:14:05.772301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1717/3473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:05.872568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:05.881426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-509c73c7-ef1d-40bc-ac6d-738f8f2b1231 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162417 Sep 06 12:14:05.882028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1757/3474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:05.904459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:05.905079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:05.912020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.912497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.912928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:05.913611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:05.914100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:05.914519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.047974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.056808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7987622f-e9ea-4a79-8a9c-27effa7c48b7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156271 Sep 06 12:14:06.057245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:06.057369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1718/3475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:05 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:06.058106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:06.064110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.064674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.065184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.066620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.067162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.067723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.198055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.206554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29588296-af34-448a-b2ec-7544f17cd788 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153046 Sep 06 12:14:06.207364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1758/3476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:06.731365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:06.731985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:06.739039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.739550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.740900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.742246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.742722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.743162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.796008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:06.796752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:06.804048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.804535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.804971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.805889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.806335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.806941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.907227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.918365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.920206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.922078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-43f6167f-7903-40ac-a141-de7844d6e5b8 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.194216 Sep 06 12:14:06.922663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1719/3477] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:06.928098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:06.928708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:06.935895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.936378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.936837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.937538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:06.938113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:06.938565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:06.955908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:06.980117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:06.989694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c38e706-77ba-40b3-885d-f42a93d9330b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.197922 Sep 06 12:14:06.990478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1759/3478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:07.080542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:07.081240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:07.083420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:07.087908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.088404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.088840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.089540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.090042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.090471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.091873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-49a74945-56e9-4111-ad45-90f9f36dfda9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168214 Sep 06 12:14:07.092465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1720/3479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:07.094811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:07.221987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:07.230838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2149d719-fad6-467d-96bd-fa627fc75952 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154115 Sep 06 12:14:07.231101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:07.236258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1760/3480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:07 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:07.236454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:07.238111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.238790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.239238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.240004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.240449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.240881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.373747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:07.382595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1a6d352-b3af-4a16-8a3f-bbdf80ea4e8a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155608 Sep 06 12:14:07.383175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1721/3481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:07.950414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:07.951028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:07.959019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.959530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.959998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:07.960713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:07.961174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:07.961602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.016061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:08.016682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:08.024308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.024796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.025239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.025973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.026698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.027108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.102608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.113086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.114862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.116082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-004fe9d7-eea3-4d5e-b8cc-43b1a74a3ebf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169586 Sep 06 12:14:08.116648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1761/3482] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:08.126618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:08.127381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:08.134612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.135109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.135551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.136265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.136721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.137147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.174753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.183936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0d0df8e4-5d70-4fb4-8dc2-cc92a625de9a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.171704 Sep 06 12:14:08.184533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1722/3483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:08.254819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:08.255551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:08.262296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.262794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.263235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.264127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.264598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.265041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.283383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.292430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-416ba526-4bc2-40f3-b42f-5b8b4b260977 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.169672 Sep 06 12:14:08.293028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1762/3484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:08.408722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:08.410093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:08.417535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.418201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.418646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.419382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:08.419851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:08.420286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:08.423285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.439084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cd8ec2c6-20c0-4c35-a774-f0c4dd5f45a7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.188346 Sep 06 12:14:08.440231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1723/3485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:08 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:08.558769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:08.568733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5df58b7f-3c7d-472e-ab91-de8a48e6444d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164108 Sep 06 12:14:08.569319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1763/3486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:09.142292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:09.142897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:09.149696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.150176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.150603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.151535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.151977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.152392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.207798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:09.208444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:09.215642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.216147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.216593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.217316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.217817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.218256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.293742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.302929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.304525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.305744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b42fd5b-9395-4c31-9ec5-df0087785a43 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167363 Sep 06 12:14:09.306307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1724/3487] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:09.320016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:09.320842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:09.326984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.327462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.327896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.328616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.329066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.329484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.370179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.384593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5103f833-bcc9-4e6c-a9f3-ac4019558034 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.181180 Sep 06 12:14:09.394965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1764/3488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:09.464242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:09.464965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:09.467088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.471481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.472048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.472634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.473254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.473741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.474179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.475464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2dd4f89e-907d-42a3-945f-72770e931ba9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163241 Sep 06 12:14:09.476057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1725/3489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:09.592939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:09.593686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:09.600023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.600590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.601097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.601899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:09.602585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:09.603183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:09.632704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.641484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b3080a19-a11a-422b-a948-8a3d0e5b8e7a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.181633 Sep 06 12:14:09.642115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1765/3490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:09 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:09.736634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:09.745501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2edc7dc4-3caf-4fe5-a82a-ba6e559a9142 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156384 Sep 06 12:14:09.746104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1726/3491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:10.333132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:10.333755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:10.340486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.340966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.341395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.342125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.342578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.342992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.411072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:10.411936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:10.423358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.425113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.425871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.426870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.427784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.428358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.488370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.497692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.499154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.500348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5f901a1-eb07-4e15-882d-7fa7bb8f0667 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171779 Sep 06 12:14:10.500916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1766/3492] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:10.506069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:10.506616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:10.512587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.513070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.513503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.514870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.514870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.515061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.576351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.586388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e7e6baa8-4b0f-42b5-a23f-bd8ddc9c2642 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.181689 Sep 06 12:14:10.587111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1727/3493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:10.654736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.664836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-164913ba-94d0-47b1-902a-bbf90c62d53e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162871 Sep 06 12:14:10.665423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1767/3494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:10.666420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:10.667044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:10.673285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.673810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.674250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.674989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.675699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.675923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.771286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:10.771916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:10.778608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.779101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.779538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.780256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:10.780715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:10.781142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:10.814209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.824371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a88467a3-2e41-441e-92cf-71598630ad14 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161649 Sep 06 12:14:10.824998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1728/3495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:10 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:10.920937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:10.929699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-00fd4b16-831b-42fe-a54d-c3c11989f00e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163612 Sep 06 12:14:10.930290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1768/3496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:11.526535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:11.527152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:11.533868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.535021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.536458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.536458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.536765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.537040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.616579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:11.617416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:11.624945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.625441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.626037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.626748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.627204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.627915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.689581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:11.699447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:11.700887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:11.702087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b14a74ee-5d1e-4fe6-89c8-86ea656dafb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.179788 Sep 06 12:14:11.702782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1729/3497] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:11.707518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:11.708123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:11.714115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.714599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.715028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.715982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.716433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.716854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.778163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:11.788165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a2c0876-c9c7-4063-8647-2978b8f02c21 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.179600 Sep 06 12:14:11.788763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1769/3498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:11.849316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:11.850112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:11.856125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.856615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.857058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.857793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.858257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.858688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.860578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:11.869571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aba2f9f3-d560-402d-99a2-b05c47bd9d1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165625 Sep 06 12:14:11.870251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1730/3499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:11.955250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:11.955870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:11.962763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.963253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.963688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.964391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:11.965498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:11.965998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:11.998278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:12.007018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8966c7e3-f4ff-4001-b9c5-f4c4dad5740f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162427 Sep 06 12:14:12.007868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1770/3500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:11 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:12.100190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:12.108597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2529feb1-fa66-4219-be9d-1b44523d3693 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157580 Sep 06 12:14:12.109197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1731/3501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:12.739166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:12.739778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:12.746473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.746957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.747390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.748082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.748533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.748959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.811938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:12.813394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:12.821754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.822247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.822717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.823428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.823890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.824319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.892968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:12.902611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:12.903794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:12.904995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b6fd53fc-93db-454c-beb8-a5eeba6ebd49 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.170620 Sep 06 12:14:12.905581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1771/3502] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:12.910200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:12.910826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:12.916958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.917448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.917914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.918638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:12.919086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:12.919514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:12.967723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:12.977347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a39487aa-d779-4e63-acc9-45c48f5e2240 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169289 Sep 06 12:14:12.977964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1732/3503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:13.034814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:13.035443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:13.041466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:13.041991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:13.042651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:13.043373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:13.043934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:13.044257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:13.060049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:13.068988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1c2f3bfc-f839-49d3-9cc8-1a727901ebd1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162235 Sep 06 12:14:13.069491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1772/3504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:13.132179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:13.132822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:13.138999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:13.139499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:13.139941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:13.140653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:13.141115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:13.141547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:13.200593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:13.209523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37c207c5-9268-451e-8c99-312567320139 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.179054 Sep 06 12:14:13.210151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1733/3505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:13 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:13.286419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:13.294962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4d03cd81-25ef-4bc0-824e-3911fb0bd384 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166849 Sep 06 12:14:13.295549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1773/3506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:13.930592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:13.931218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:13.937947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:13.938527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:13.938974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:13.939671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:13.940146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:13.941470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.004168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:14.004904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:14.011530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.012034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.012485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.013213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.013704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.014146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.082017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.091134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.092737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.093859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04af632e-1aa4-448a-b512-f76b248b4447 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167261 Sep 06 12:14:14.094436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1734/3507] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:14.099257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:14.099869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:14.119672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.120170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.120614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.121336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.121853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.122283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.156831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.165732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58664d54-6dcf-473c-9d66-8f5d0c85394c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165927 Sep 06 12:14:14.166331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1774/3508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:14.234324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:14.234954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:14.241691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.242184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.242620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.243321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.243771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.244191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.270138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.278897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de70ac52-00fb-41be-bd62-284a6efc7b4a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183449 Sep 06 12:14:14.280179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1735/3509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:14.320641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:14.321352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:14.328022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.328520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.328959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.329688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:14.330148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:14.330578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:14.383787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.392516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f37c28f1-124f-4384-b037-172a02d39a15 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161996 Sep 06 12:14:14.393329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1775/3510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:14 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:14.474324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:14.482782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32b5fcbf-6cc2-4d9a-a513-66e0df42956d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165960 Sep 06 12:14:14.483383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1736/3511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:15.120817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:15.121431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:15.128278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.128768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.129206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.129936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.130446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.131168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.263897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:15.264675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:15.270798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.271286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.271725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.272426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.272880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.273307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.277469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.277869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:15.279967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:15.289210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.290740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.291980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-69a3e7b5-8246-4775-b4c2-ccb37ac471a0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.175408 Sep 06 12:14:15.292543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1776/3512] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:15.303941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:15.304809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:15.312057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.312647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.313130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.313902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.314404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.314836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.442086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.452079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c05f7f5d-365f-4825-9cb3-1e79df6eb76d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.266909 Sep 06 12:14:15.452980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1737/3513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:15.459653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:15.460746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:15.461569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.468936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.469674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.470129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.470998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.471977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.473172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.474440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6eeaeb5a-205d-4cca-b74f-7edd90605a7b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175354 Sep 06 12:14:15.475521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1777/3514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:15.506200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:15.506820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:15.513108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.513604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.514081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.514787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:15.515247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:15.515702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:15.615560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.624061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3fa143f-133a-4876-afeb-a0a470d20994 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.169926 Sep 06 12:14:15.624647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1738/3515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:15 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:15.674057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:15.682485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c3dab225-4c87-46ae-b5b1-87499049cc64 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.180077 Sep 06 12:14:15.683072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1778/3516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:16.318344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:16.318955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:16.325549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.326062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.326493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.327185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.327665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.328086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.464469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.475719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.477182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.477325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:16.477862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:16.478417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b9a2d0e-0e33-48cd-b5c9-b656ec5f27b6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164201 Sep 06 12:14:16.478997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1739/3517] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:16.480002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:14:16.480147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 (ip 10.222.0.18) !!! Sep 06 12:14:16.481545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:16.488661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.489143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.489575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.490294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.490747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.491169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.498953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:16.499652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:16.506586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.507163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.507795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.508560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.509087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.509580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.627359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.636815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-68517e0f-7561-4be7-a103-fc7c5f3100b0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163476 Sep 06 12:14:16.637408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1779/3518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:16.644353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.650758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:16.651885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:16.654062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b626fc40-9046-4060-87c3-fb165fbc1ed4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158980 Sep 06 12:14:16.654744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1740/3519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:16.658053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.658738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.659817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.660634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.661090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.661521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.708019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:16.708623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:16.714643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.715059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.715487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.716168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:16.716613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:16.717028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:16.797976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.806686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b3a1fb46-85fc-48bd-b400-f5f2771b8602 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159792 Sep 06 12:14:16.817477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1780/3520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:16 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:16.851886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:16.860131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d30350d-6377-4094-8102-3449ab90e593 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156495 Sep 06 12:14:16.860706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1741/3521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:17.504652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:17.505243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:17.511877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.512365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.512804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.513499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.513987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.514419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.644582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:17.654089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:17.655557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:17.656751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-964331f5-6345-48a4-9565-52acf999eac3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156633 Sep 06 12:14:17.657313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1781/3522] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:17.660476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:17.661118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:17.667624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.668102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.668538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.669214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.669737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.670217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.678079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:17.678831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:17.685121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.685606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.686082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.686779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.687235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.687659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.805362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:17.813543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f2cb725b-685f-4d34-a797-091cf4678870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156998 Sep 06 12:14:17.814157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1742/3523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:17.819656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:17.828807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-72d1d4a6-0319-4ca0-bbcd-3280444b1104 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154690 Sep 06 12:14:17.833762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:17.834352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1782/3524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:17.834481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:17.836214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:17.841981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.842474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.842915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.843614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.844075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.844504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.885033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:17.885675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:17.891720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.892210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.892651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.893369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:17.893875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:17.894494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:17.979828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:17.989732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92a2a569-7fe0-41c4-8214-4ddea9628e18 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160881 Sep 06 12:14:17.990536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1743/3525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:17 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:18.036244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:18.045089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-86981a36-f935-4d6f-a55e-0d95c706c23f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163839 Sep 06 12:14:18.045714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1783/3526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:18.684590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:18.685245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:18.691647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:18.692115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:18.692546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:18.693215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:18.693676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:18.694095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:18.825527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:18.834798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:18.836205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:18.837391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d668fbe8-feba-40c8-863b-074c562b1119 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156713 Sep 06 12:14:18.838067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1744/3527] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:18.840240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:18.840921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:18.847936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:18.848419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:18.849177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:18.849990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:18.850463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:18.850870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:18.853974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:18.856115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:18.861171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:18.861668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:18.862181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:18.862918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:18.863442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:18.863937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:18.991457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:19.000227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-936e9aa1-815b-4aac-9d4a-5f2c9b00aefa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164032 Sep 06 12:14:19.000811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1784/3528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:19.006118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:19.015059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc90f417-f7a7-44a0-b081-00a033d3e048 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165046 Sep 06 12:14:19.015646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1745/3529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:19.021951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:19.022577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:19.029266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:19.029624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:19.030533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:19.030819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:19.031248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:19.031757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:19.068851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:19.069462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:19.076634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:19.077133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:19.077574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:19.078319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:19.078791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:19.079218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:19.176751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:19.185030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c0a4784-9217-4ba3-bddb-003680376a7c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.167819 Sep 06 12:14:19.185614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1785/3530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:19 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:19.214117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:19.222330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f071f79-01e5-408a-b9b9-106b32caa684 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157861 Sep 06 12:14:19.222916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1746/3531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:19.864352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:19.864927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:19.871461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:19.871944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:19.872379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:19.873066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:19.873519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:19.873972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.006228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.015157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.016605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.017907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8230124-07c4-4d37-8b77-28ec6b4da987 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158659 Sep 06 12:14:20.018711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1786/3532] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:20.023307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:20.024041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:20.031155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.031698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.032209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.033023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.033520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.034596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.041219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:20.042049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:20.048177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.048896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.049342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.051531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.052004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.052433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.177829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.186200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ad693dc4-2909-4ca5-aaa5-8a96db26b861 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166873 Sep 06 12:14:20.186793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1747/3533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:20.197982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.207588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ff994e9f-113b-485d-95f4-5ff2010de2b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.170167 Sep 06 12:14:20.208177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1787/3534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:20.208778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:20.209517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:20.217848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.218340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.218849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.219486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.219949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.220627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.245823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:20.246546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:20.254018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.254519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.254962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.255670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:20.256130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:20.256563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:20.377380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.386573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d760fcfa-13c6-474e-b6d2-125421d30d4a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.181842 Sep 06 12:14:20.387164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1748/3535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:20 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:20.397112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:20.406196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7157219e-a61a-4566-b20e-14b78c37c92d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164167 Sep 06 12:14:20.406196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1788/3536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:21.044836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:21.047307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:21.059545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.060551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.061473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.062772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.063617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.064413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.204898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.210771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:21.211391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:21.213840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.215314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.216498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ab1bbb60-c1b5-4be0-a928-6f4f3dd5820a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.176663 Sep 06 12:14:21.217060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1749/3537] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:21.217864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.218362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.218803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.219503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.219965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.220392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.230755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:21.231368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:21.239089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.239571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.240011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.240700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.241147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.241601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.363867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.372485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3622ba13-afe5-46b3-aaa7-721a3c5c1160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165776 Sep 06 12:14:21.373411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1789/3538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:21.381338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.389845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66ffa6a4-6b48-4857-b199-5059e6281804 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162754 Sep 06 12:14:21.390563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1750/3539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:21.412061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:21.412684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:21.418807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.419294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.419737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.420437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.420901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.421328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.430776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:21.431414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:21.437311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.437834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.438275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.438977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:21.439431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:21.439866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:21.558119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.566388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-751e1660-5e3f-460b-b380-155e1ceb23c1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158822 Sep 06 12:14:21.566976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1790/3540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:21 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:21.574845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:21.583665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-347d7344-1c4d-42d6-9937-22328212f0c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156762 Sep 06 12:14:21.584237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1751/3541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:22.244529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:22.245177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:22.285065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.285065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.285065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.285065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.285738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.285738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.395705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:22.396323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:22.400046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.403261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.403756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.404196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.404897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.405358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.405820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.409825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.411298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.412496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9fff6c1a-cf61-4738-9f26-77058badccbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171981 Sep 06 12:14:22.413055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1791/3542] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:22.420576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:22.421138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:22.428216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.428795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.429435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.430165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.430628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.431059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.541609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.550449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-85abd146-9d6d-4ae2-8398-3c70b390cb51 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158612 Sep 06 12:14:22.557803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1752/3543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:22.566182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.574607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d577a0e4-9c69-4a3c-8213-a65e113afc25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160591 Sep 06 12:14:22.575168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1792/3544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:22.590456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:22.591069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:22.597226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.597760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.598199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.599300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.599758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.600187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.607343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:22.607966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:22.614712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.615203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.615648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.616354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:22.616824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:22.617246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:22.633307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:22.732509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.734714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:22.743660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63cb1409-9c4d-4055-9813-a82d9b155d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157008 Sep 06 12:14:22.744256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1753/3545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:22 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:22.749247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:22.758285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5d922e56-3a2a-4349-a268-e6bab0618c18 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154792 Sep 06 12:14:22.758857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1793/3546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:23.439898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:23.440800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:23.447359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.447839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.448265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.448956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.449408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.449862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.574540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:23.575157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:23.582317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.582802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.583322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.583936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.584382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.584466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.584802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.593289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.594770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.595996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7876e8f2-e49b-4a46-ab02-05b5d1a72d1f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160261 Sep 06 12:14:23.596570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1754/3547] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:23.601473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:23.602105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:23.607924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.608415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.608854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.609547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.610033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.610460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.721569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.730320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4645572d-3fe3-45e2-b2ba-98d0eb55c12b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159588 Sep 06 12:14:23.730901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1794/3548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:23.741596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.749807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f123089-2c09-449b-8e51-6d87314fd980 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152273 Sep 06 12:14:23.750369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1755/3549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:23.766751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:23.767364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:23.774514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.774995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.775431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.776120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.776825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.777253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.782039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:23.782666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:23.788694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.789186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.789625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.790348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:23.790811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:23.791245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:23.914210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.922480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e689ef70-afff-429f-819a-cbd3b4ac2ba5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159468 Sep 06 12:14:23.923074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1795/3550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:23 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:23.924603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:23.932935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-acb04e47-f337-4691-8ccd-c029cf5662f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154686 Sep 06 12:14:23.933580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1756/3551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:24.623771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:24.624306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:24.631804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.632293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.632737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.633428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.633914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.634347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.755066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:24.755691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:24.762219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.762710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.763149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.763852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.764325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.764735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.765831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:24.774843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:24.776541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:24.777754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0baafce6-1e0d-421a-aeb2-e23b0a790ab6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157969 Sep 06 12:14:24.778325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1796/3552] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:24.784604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:24.784604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:24.790054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.790546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.790989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.791685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.792138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.792564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.898244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:24.906965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c58a38f-6a00-4204-a7aa-4e6738f70675 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156379 Sep 06 12:14:24.907642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1757/3553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:24.928609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:24.936857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6d0323b7-0cc4-4fc7-a049-732d5ec81026 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157578 Sep 06 12:14:24.937440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1797/3554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:24.947147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:24.947885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:24.954536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.955024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.955470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.956247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.956708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.957001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:24.957136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.957806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:24.964095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.964591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.965035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:24.965763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:24.966226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:24.966658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:25.088523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:25.097491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20ba9fee-501f-4329-b181-775696afa185 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.154333 Sep 06 12:14:25.098048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1758/3555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:25.102084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:25.110419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dfe02e22-ac6d-49d0-aaef-3f73a46c8631 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158050 Sep 06 12:14:25.111153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1798/3556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:25.805853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:25.806478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:25.813711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:25.814147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:25.814774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:25.816044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:25.816509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:25.816941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:25.930417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:25.931173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:25.937687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:25.938337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:25.938805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:25.939655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:25.940665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:25.941231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:25.950836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:25.960468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:25.961954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:25.963139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d65cd762-d557-4b84-bcff-362632b465b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161307 Sep 06 12:14:25.963710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1759/3557] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:25.968451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:25.969062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:25.975493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:25.975981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:25.976423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:25.977124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:25.977585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:25.978133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:26.073765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:26.083502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-08fc7bb2-4470-4803-a349-a35fc4c302bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156639 Sep 06 12:14:26.084099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1799/3558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:26.116875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:26.120486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:26.121107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:26.126422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cbd727f1-37e9-481f-97de-9ef3a5a67a15 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161481 Sep 06 12:14:26.127002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1760/3559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:26.127120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:26.128384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:26.128850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:26.129571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:26.130064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:26.130635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:26.138523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:26.139173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:26.145454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:26.146096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:26.146539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:26.147246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:26.147703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:26.148182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:26.267614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:26.275968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8ea71f71-0856-49f7-998e-d20ae16f3837 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159255 Sep 06 12:14:26.276801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1800/3560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:26 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:26.289590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:26.297742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3c6eb6bd-cc14-4431-83e5-2c86a57cee0a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166134 Sep 06 12:14:26.298335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1761/3561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:26.988438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:26.989050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:26.995222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:26.995700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:26.996130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:26.996808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:26.997256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:26.997702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.107598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:27.108413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:27.115762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.116249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.116686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.117568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.118249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.118688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.129886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.138742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.140232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.141416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7e163855-066d-4929-87bf-c0b65df55afb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157004 Sep 06 12:14:27.142012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1801/3562] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:27.159382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:27.160319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:27.166385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.166868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.167303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.168029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.168483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.168912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.257273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.269400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1b0ecfb9-aead-452c-bc50-a18f4a8dd41e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164920 Sep 06 12:14:27.270195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1762/3563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:27.299037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:27.299688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:27.304980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.305943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.306441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.306953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.307616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.308165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.308595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.315708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7b2a7c65-9ba1-436f-97d3-8cc3a114ec50 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160033 Sep 06 12:14:27.317370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1802/3564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:27.322948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:27.323642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:27.329994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.330676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.332421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.333100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:27.333635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:27.334161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:27.469678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.477145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c579fb1b-5198-439a-b34f-90fb13771cdd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.181927 Sep 06 12:14:27.477746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1763/3565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:27 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:27.488387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:27.496756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-baec431f-266f-4734-974f-597de563babb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.178277 Sep 06 12:14:27.497327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1803/3566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:28.170216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:28.170830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:28.178334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.178821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.179255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.179973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.180424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.180846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.293020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:28.293661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:28.301239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.301754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.302197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.303005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.303379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.303807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.312715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.322464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.323907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.325079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-137ae7e0-f0d9-42a7-a134-7dd901bdd133 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158877 Sep 06 12:14:28.325670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1764/3567] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:28.340700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:28.341345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:28.348825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.349314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.349787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.350506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.350954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.351378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.437999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.457219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-33684b06-8d91-426d-a4dd-14b52b997206 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167897 Sep 06 12:14:28.457918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1804/3568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:28.485167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.493752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41f982e7-4794-4cb1-925c-68e30f537b27 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156752 Sep 06 12:14:28.494512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1765/3569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:28.500218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:28.500840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:28.508583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.509287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.510316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.511721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.512187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.513066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.521993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:28.522609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:28.534436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.534436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.534436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.534436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:28.534738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:28.534738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:28.648108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.656813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8578d959-ca88-41bc-8f58-7cc7e1ad7a83 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160585 Sep 06 12:14:28.657391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1805/3570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:28.669338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:28.677603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6b5f51a9-7a4e-49e9-b724-47242e7046b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160795 Sep 06 12:14:28.678198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1766/3571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:29.352382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:29.352994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:29.359794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.360241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.360738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.361447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.362239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.362871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.480540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:29.481154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:29.488211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.488692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.489126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.489852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.490309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.490737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.547355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:29.557545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:29.559101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:29.578410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-665d9d86-5a90-45f1-8c6e-c300fc2dca95 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.211894 Sep 06 12:14:29.578410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1806/3572] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:29.578410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:29.578410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:29.578410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.579510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.579510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.579510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.579510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.579732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.645149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:29.654086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ca5b7da-34ef-4527-8fc6-24b8cf0a6b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.177369 Sep 06 12:14:29.655322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1767/3573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:29.687596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:29.688234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:29.694452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.695245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.695737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.696440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.696894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.697313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.840651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:29.850084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4608e72b-6b04-403d-bc8a-7b7476751f07 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.172333 Sep 06 12:14:29.850680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1768/3574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:29 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:29.861807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:29.861807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:29.862673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.863286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.863730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:29.864442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:29.864904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:29.865397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:30.005680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:30.014563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f45a84d8-3801-4da6-8742-b9e7578fe2f3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162751 Sep 06 12:14:30.015343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1769/3575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:30.037366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:30.045741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b22a3af0-3de0-4c5f-81be-7a4e8052cf01 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.483059 Sep 06 12:14:30.046330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1807/3576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:30.586843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:30.587373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:30.593920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:30.594398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:30.594831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:30.595514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:30.595965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:30.596412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:30.611056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:30.679516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:30.680352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:30.687241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:30.687819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:30.688400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:30.689105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:30.689700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:30.690926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:30.731667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:30.741472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:30.742946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:30.744128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b2590134-bc95-4753-b661-329d41678bce tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161339 Sep 06 12:14:30.744695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1770/3577] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:14:30.829136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:30.837470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1780f4fb-e36a-4590-a86f-6b3a75b39b43 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162791 Sep 06 12:14:30.838012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1808/3578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:30 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:30.874111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:30.874729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:30.881351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:30.881950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:30.882394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:30.883091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:30.883559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:30.883976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.015171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:31.025666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bd28c24e-86cf-494b-8b6b-a9318ce169a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155262 Sep 06 12:14:31.026258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1771/3579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:31.040185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:31.040880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:31.046958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.047444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.047877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.048599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.049062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.050124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.069574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:31.070221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:31.076105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.076590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.077026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.077762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.078203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.078637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.206443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:31.215131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0a459796-f846-4713-b716-597449bc17c9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.178662 Sep 06 12:14:31.215955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1809/3580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:31.231149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:31.240366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f4072de-e17f-49e9-93f2-760bcfbc2940 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175066 Sep 06 12:14:31.240947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1772/3581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:31 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:31.770711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:31.771323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:31.778940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.779424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.779868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.780563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.781023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.781451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.784203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:31.860819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:31.861438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:31.868311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.868751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.869191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.869921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:31.870401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:31.870814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:31.917632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:31.926786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:31.928215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:31.929411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-14b7cc40-0d30-4568-91c6-9072453abb27 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162673 Sep 06 12:14:31.930019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1810/3582] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:32.009734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:32.017922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8e529c5e-5f21-475e-bed3-8bd7b789bd8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161003 Sep 06 12:14:32.019098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1773/3583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:32.050342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:32.050961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:32.056993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.057501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.057954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.058649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.059111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.059542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.187819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:32.197200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c05ba75a-4297-4af2-97e1-0208a17d2c26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.150685 Sep 06 12:14:32.197806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1811/3584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:32 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:32.239724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:32.240344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:32.246521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.247018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.247462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.248167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.248627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.249059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.263899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:32.264539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:32.270989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.271588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.272194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.272896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.273350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.273846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.388419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:32.397429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-007db2b4-874d-433f-863b-3d11c4a124ee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162230 Sep 06 12:14:32.398051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1774/3585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:32.415232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:32.423848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa3bf5f3-ffaf-443b-b8a5-1c91b21c816c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163857 Sep 06 12:14:32.425816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1812/3586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:32.955884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:32.956496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:32.963206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.963688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.964121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:32.964806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:32.965260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:32.965715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.041630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:33.042209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:33.048272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.048752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.049219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.050351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.050871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.051316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.101047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.110008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.111487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.112672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c2e005a-54a9-4049-ae98-a9f3fd7e9cf9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161176 Sep 06 12:14:33.113242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1775/3587] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:33.186413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.195054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4738ddef-bb4e-4a96-a79f-2aeb277ece30 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157366 Sep 06 12:14:33.195645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1813/3588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:33.220369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:33.221026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:33.227531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.228013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.228451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.229167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.229622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.230074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.421382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:33.422035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:33.428598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.429097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.429539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.430286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.430747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.431174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.569386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.581160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb2a0926-b629-4f50-89b5-0e6b26c4c282 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160685 Sep 06 12:14:33.586763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1814/3589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:33.587944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.592554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:33.593274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:33.597660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1494297d-3bdf-4a06-9f9c-670f3caedbbb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.381043 Sep 06 12:14:33.598255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1776/3590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:33 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:33.599806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.600295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.600730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.601429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:33.601915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:33.602337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:33.738251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:33.746888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-03f77abc-2b1d-4a33-84b2-5699764326b6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158865 Sep 06 12:14:33.747457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1815/3591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:34.139877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:34.140411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:34.147637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.148121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.148553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.149240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.149714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.150165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.218841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:34.219610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:34.228223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.228847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.229363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.230412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.230842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.231394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.285637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.294321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.295769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.296945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-982f3a03-c383-46d2-9bcf-09b233d77f7b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161040 Sep 06 12:14:34.297528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1777/3592] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:34.366461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.374663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a2650da5-7b81-4332-aa9d-a2a2aaa75121 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160412 Sep 06 12:14:34.375232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1816/3593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:34.602976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:34.603587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:34.611143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.612201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.612875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.613785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.614344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.615136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.621778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:34.622403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:34.629054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.629539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.630007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.630712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.631171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.631595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.757447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.767565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-19bfbc22-66e8-4758-9e16-ed5099ec9c21 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168417 Sep 06 12:14:34.768156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1778/3594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:34.774037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:34.774799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:34.781563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.782097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.782218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.782530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.783229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:34.783676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:34.786773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:34.791359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ff95f00d-42db-4e2c-bab9-687a2542bfff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.173958 Sep 06 12:14:34.791966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1817/3595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:34.958983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:34.967254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00a8cded-f363-4b7c-b380-7f3c5408596b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.198059 Sep 06 12:14:34.967838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1779/3596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:35.322548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:35.323177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:35.329973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.330465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.330906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.331615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.332069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.332708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.399330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:35.400894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:35.410000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.411436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.411883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.412801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.413270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.413719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.483763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:35.493363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:35.495397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:35.496589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d444071f-d8be-46f9-ba32-85b23cd2a526 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.178050 Sep 06 12:14:35.497599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1818/3597] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:35 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:35.575946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:35.584825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8a60daf8-53c4-40ee-9ebe-a197b57221c5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.189374 Sep 06 12:14:35.585415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1780/3598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:35.792105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:35.792636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:35.798672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.799162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.799602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.800290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.800745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.801283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.818688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:35.819388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:35.825915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.826393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.826832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.827539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:35.827995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:35.828452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:35.974422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:35.982820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:35.985211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a45837ce-face-41f1-9cfa-4e8eb638e6fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.196914 Sep 06 12:14:35.985944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1819/3599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:35.992668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3968e843-90b8-4049-9593-f9d9741bde70 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.179092 Sep 06 12:14:35.993618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1781/3600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:35 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:35.997976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:35.999556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:36.008293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:36.008928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:36.009948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:36.010667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:36.011129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:36.011561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:36.148763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:36.161395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-350a77db-39e8-41d0-8917-744f474ef1b2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168138 Sep 06 12:14:36.162289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1820/3601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:36.523413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:36.524015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:36.530643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:36.531136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:36.531550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:36.532233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:36.532688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:36.533103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:36.608445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:36.609060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:36.618510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:36.619100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:36.619547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:36.621891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:36.622376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:36.622816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:36.670725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:36.680099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:36.681553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:36.682762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-955c6e81-d82c-4ada-8e08-64bf572cc19d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163642 Sep 06 12:14:36.683571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1782/3602] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:36.754851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:36.763084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6171fb6-2f82-4831-9146-03700a908e2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158569 Sep 06 12:14:36.763678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1821/3603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:36 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:37.016964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:37.017604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:37.023766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:37.024363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.024471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:37.024853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.025293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.026023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.027223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.027223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.031375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.031859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.032291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.032986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.033437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.034062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.174752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.177176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.183367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7c82d3f3-313f-4884-b5a1-165e8bd686b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164010 Sep 06 12:14:37.183967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1822/3604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:37.191042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7331b4c7-a1d6-4119-bfe6-5474c12d60a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.177897 Sep 06 12:14:37.193684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1783/3605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:37 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:37.195251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:37.195981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:37.204558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.205044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.205488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.206216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.206712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.207695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.343736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.352096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d6fa90a7-371b-48e0-a37f-e3ca62ec1b43 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160746 Sep 06 12:14:37.352657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1823/3606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:37 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:37.708369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:37.708985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:37.715469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.715949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.716386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.717082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.717538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.717992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.787211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:37.787851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:37.794571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.795145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.795604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.796298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:37.796742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:37.797191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:37.851044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.859963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.861416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.862615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a6eb629-6d73-4c83-9a1e-546621ebc221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158303 Sep 06 12:14:37.863193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1784/3607] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:37.929590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:37.937858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae3121ef-c229-4485-9371-49760ba4e5b1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154874 Sep 06 12:14:37.938438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1824/3608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:38.207077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:38.207916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:38.213997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.214305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:38.214487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.214918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:38.215007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.215613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.216075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.216505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.220722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.221202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.221686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.222385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.223414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.223806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.356357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:38.365466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a624703e-8c6d-4c19-bb76-aa1283985fee tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162196 Sep 06 12:14:38.366481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1785/3609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:38.368606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:38.375496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:38.376113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:38.379318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae636aee-c3f8-4cfa-878d-e6408a60529f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168241 Sep 06 12:14:38.380580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1825/3610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:38.383439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.383937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.384377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.385096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.385541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.386011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.520257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:38.529342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3f5d43ac-a194-487c-94ac-4961d9245a9b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157882 Sep 06 12:14:38.529990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1786/3611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:38.889221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:38.889901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:38.897349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.897878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.898325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.899044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.899485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.899916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.962044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:38.962665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:38.968705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.969180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.969605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.970309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:38.970759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:38.971178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:38.974146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:39.032332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.034549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:39.043054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.044507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.045767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9d829b63-25a9-4ac3-9cee-181e819a1691 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160400 Sep 06 12:14:39.046323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1826/3612] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:39.106868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.116255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-264b7277-35eb-4460-901c-92701eeb22a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159017 Sep 06 12:14:39.116831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1787/3613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:39.388809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:39.389456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:39.396299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:39.396793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:39.397244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:39.397988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:39.398455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:39.398884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:39.403339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:39.403895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:39.410426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:39.412337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:39.412773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:39.413499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:39.414000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:39.414436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:39.543852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.554435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-39b2cb2a-0b5d-48a1-ad73-ebb8c592f08f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.169368 Sep 06 12:14:39.555041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1827/3614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:39.560108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:39.560584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:39.567916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:39.568416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:39.568854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:39.569569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:39.569952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.570070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:39.570517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:39.580963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-99ab70cc-4504-4b62-b618-4046942207a1 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.181792 Sep 06 12:14:39.582056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1788/3615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:39 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:39.717538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:39.726687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8263d366-afe3-4fc1-b53b-f931b374a44f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.170625 Sep 06 12:14:39.727302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1828/3616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:40.072150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:40.072716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:40.079311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.079792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.080224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.080947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.081402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.081855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.140509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:40.141340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:40.145726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:40.153359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.153891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.154338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.155078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.155541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.155968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.226668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.237196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.239623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.241051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b0b94ff4-5659-4362-ac4f-5770ba011022 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.172935 Sep 06 12:14:40.241983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1789/3617] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:40.315725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.325449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ebf0ff50-3f6c-4ab2-9225-bef4d37ac65d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.188831 Sep 06 12:14:40.326000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1829/3618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:40.580568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:40.581101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:40.587464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.587957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.588399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.589259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.589752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.590186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.605829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:40.606450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:40.612626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.613117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.614169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.615084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.615545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.615977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.730070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.741158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7793e9d6-7718-44a9-91c5-e5c36432738c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164469 Sep 06 12:14:40.741785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1790/3619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:40.751095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:40.751848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:40.758776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.759301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.759702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.760395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:40.760847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:40.761269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:40.762370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.772585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bd1ca269-f2b0-4041-88af-3b0366029787 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170536 Sep 06 12:14:40.773291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1830/3620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:40 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:40.922199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:40.931415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7690547-6b8a-4fa2-a6aa-bf614243edc4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.184700 Sep 06 12:14:40.932009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1791/3621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:41.268471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:41.269077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:41.276010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.276765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.277488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.277907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.278358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.278779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.349734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:41.350523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:41.357470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.358091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.358605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.359394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.359955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.360455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.425336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:41.435262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:41.437030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:41.437955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ff196929-cfda-44de-acbd-022bd119af4c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.173382 Sep 06 12:14:41.438526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1831/3622] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:41.518632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:41.528127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3a84259-590e-4d92-bdb8-3ff80a0ae8ee tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.182965 Sep 06 12:14:41.528711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1792/3623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:41.764917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:41.765536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:41.771914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.772337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.772776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.773480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.773976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.774408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.796593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:41.797201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:41.799073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:41.805685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.806174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.806608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.807307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.807759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.808188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.935418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:41.953018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-68acb5c2-6aa4-4e4f-b524-41e9a1cc8f98 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.191549 Sep 06 12:14:41.954245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1832/3624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:41.962967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:41.964112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:41.975527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.976417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.977198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.978533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:41.979418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:41.980215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:41.980514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:41.992552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-56d10bbe-87fc-4e1e-a61d-57a8673e18dd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.199740 Sep 06 12:14:41.993145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1793/3625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:41 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:42.125769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:42.134879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6a75c4b-3438-4ea1-8d15-54f119e95e5f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.179222 Sep 06 12:14:42.135463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1833/3626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:42.464435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:42.465060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:42.471683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:42.472161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:42.472650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:42.474150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:42.474612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:42.475034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:42.552961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:42.553962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:42.561505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:42.562056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:42.562493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:42.564055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:42.564524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:42.564990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:42.614589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:42.623961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:42.625402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:42.626609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6080f386-a9de-41fc-8b06-0e332f8706c9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166130 Sep 06 12:14:42.627257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1794/3627] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:42.702747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:42.712329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e47cbb0e-808a-4c92-aae2-5d9cb8be8f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163534 Sep 06 12:14:42.712935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1834/3628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:42 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:42.977153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:42.977807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:42.983933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:42.984415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:42.984840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:42.985524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:42.986033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:42.986457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.019879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:43.020546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:43.027014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.027513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.027955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.028658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.029119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.029556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.125710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.135219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31542b0c-b75f-4452-9555-e0075a5d74bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161813 Sep 06 12:14:43.135827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1795/3629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:43.159499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:43.160371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:43.167535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.168069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.168510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.169226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.169702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.170136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.175689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.185123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8b16cd2f-f5d3-4ce2-ac6c-aba140f38d26 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.169358 Sep 06 12:14:43.186150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1835/3630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:43 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:43.307910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.316248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3ca077e2-7cfc-4dd7-b02a-acd933f8de25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160638 Sep 06 12:14:43.317269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1796/3631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:43.654907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:43.655522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:43.662084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.662573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.663007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.663705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.664163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.664586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.736217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:43.736827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:43.744645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.746026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.746469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.747174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:43.747632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:43.748061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:43.798763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.808772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.810263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.811441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6fa3c0a7-21ba-4086-b125-30b040b13b76 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160751 Sep 06 12:14:43.812005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1836/3632] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:43.886480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:43.895486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5b1c895f-efa0-4fa6-a5ae-5285e003c6c3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163104 Sep 06 12:14:43.896081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1797/3633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:44.159935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:44.161398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:44.167718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.168208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.168711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.169416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.169910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.170337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.210906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:44.211531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:44.221419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.222044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.222623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.223446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.224000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.224501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.347791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:44.356771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-14ee478e-9aea-49af-bc98-9880244172bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.200647 Sep 06 12:14:44.357389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1837/3634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:44.362330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:44.362958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:44.369723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.370448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.371057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.371931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.372533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.373102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.382062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:44.391087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9883bedb-dd8b-447b-8736-7f6edbf7595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.184455 Sep 06 12:14:44.393894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1798/3635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:44 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:44.536376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:44.544945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9e02f6a-ca04-4fd5-b295-ff06d140d352 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.186483 Sep 06 12:14:44.545522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1838/3636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:44.837585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:44.838423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:44.844912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.845402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.845878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.846575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.847038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.847469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.918599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:44.919257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:44.926402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.927179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.927441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.928154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:44.928929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:44.929019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:44.990194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:44.999397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:45.000830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:45.002060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-45c5b2c1-979e-4fe9-adff-94eaa37688a3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168524 Sep 06 12:14:45.002630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1799/3637] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:45.069933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:45.078918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fd07f087-2fa5-428c-9992-b7d009032219 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164092 Sep 06 12:14:45.079686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1839/3638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:45.380667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:45.381279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:45.387351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:45.387833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:45.388270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:45.388969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:45.389429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:45.389898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:45.415643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:45.416267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:45.422363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:45.422851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:45.423296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:45.423998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:45.424470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:45.424896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:45.536653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:45.545170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3453343b-b156-401a-844b-22de170597bc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168547 Sep 06 12:14:45.546104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1800/3639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:45.574172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:45.575029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:45.576483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:45.586713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:45.587634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b20ba6ec-db4f-44f1-9174-0430673530bb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.175750 Sep 06 12:14:45.587750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:45.588623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:45.590124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:45.590629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1840/3640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:45 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:45.592762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:45.592762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:45.733321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:45.742221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-57fdbbdb-457c-4810-90cc-0f36d18dfa81 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.177127 Sep 06 12:14:45.742796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1801/3641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:46.027893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:46.028506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:46.035149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.035585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.036030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.036734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.037191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.037622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.104177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:46.104788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:46.111478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.111978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.112421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.113638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.114524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.114954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.172444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.182119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.183587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.184783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6dede7c5-84b9-4964-9945-3aec383513ab tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161121 Sep 06 12:14:46.185347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1841/3642] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:46.254664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.263627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b58588df-6879-4c5d-9ee1-e21d96d3a4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163256 Sep 06 12:14:46.264223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1802/3643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:46.570544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:46.571161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:46.577129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.577624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.578108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.579006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.579469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.579901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.611406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:46.612120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:46.618697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.619281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.619802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.620788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.621110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.621636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.731487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.741443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-672d63da-75fa-47af-97e4-9408d2f87b63 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.175750 Sep 06 12:14:46.742086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1842/3644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:46.767194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:46.767832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:46.774728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.775425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.775878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.776859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:46.777326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:46.777794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:46.780809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.783201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:46.791750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2a081270-96f0-49ae-9915-c46e2ac2aea8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.183887 Sep 06 12:14:46.792405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1803/3645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:46 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:46.795039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:46.920553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:46.930419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f09cf7b3-27d0-44e3-81a4-1ab8a67e7668 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167716 Sep 06 12:14:46.931011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1843/3646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:47.210246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:47.210863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:47.217812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.218292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.218721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.219407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.219852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.220270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.287930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:47.288652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:47.295222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.295776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.296375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.297095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.297547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.298016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.356242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:47.366494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:47.367949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:47.369130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a29bd647-bf8f-45cf-b7c0-d2992e3b8a40 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162961 Sep 06 12:14:47.369713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1804/3647] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:47.433956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:47.442328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-456a6a9e-6f6f-49bb-8b8d-e6e1035e4897 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158955 Sep 06 12:14:47.442916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1844/3648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:47.765391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:47.766055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:47.772817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.773306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.773771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.774471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.775253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.775366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.817190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:47.817866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:47.824038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.824529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.824962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.825682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.826144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.826568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.911147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:47.919614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d4c3491b-913b-4c10-a3d5-1ebbdd074380 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158061 Sep 06 12:14:47.920201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1805/3649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:47.957760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:47.958390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:47.964622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.965105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.965544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.966331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:47.966741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:47.967170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:47.971069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:47.980327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed5d94e0-07bb-43e3-a2a1-ed051d83158b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.167768 Sep 06 12:14:47.980923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1845/3650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:47 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:48.106216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:48.114542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d087b50c-46e4-4730-a2f2-0f9eebfcbf82 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164137 Sep 06 12:14:48.115154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1806/3651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:48.394644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:48.395280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:48.401949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:48.402442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:48.402883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:48.403576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:48.404035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:48.404465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:48.465942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:48.466554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:48.473067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:48.473576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:48.474044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:48.474730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:48.475182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:48.475604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:48.541999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:48.551296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:48.552957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:48.554518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-665e097b-a91c-4279-ad20-c9350338dffe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163551 Sep 06 12:14:48.554741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1846/3652] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:48.607223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:48.616416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0c9952bb-3670-4b20-b048-33b312aa5a35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154412 Sep 06 12:14:48.616995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1807/3653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:48.943455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:48.944077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:48.950118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:48.950612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:48.951062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:48.951756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:48.952218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:48.952652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.004544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:49.005108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:49.011218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.012485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.012928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.013740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.014096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.014546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.085345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.093988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-de52f23e-1d2c-4901-bcbb-bd488b6b4d89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154359 Sep 06 12:14:49.094572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1847/3654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:49.152291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.154189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:49.154813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:49.161849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5cb0fe22-172a-430e-a48f-f23fcb59e85d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160235 Sep 06 12:14:49.162197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.162451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1808/3655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:48 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:49.162700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.163196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.163918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.164382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.164813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.301115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.309460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9fe0250-7dfb-41fa-a30f-a951062206c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159382 Sep 06 12:14:49.310050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1848/3656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:49.580564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:49.581087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:49.589360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.589912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.590347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.591044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.591496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.591916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.640214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:49.640981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:49.648150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.648643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.649079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.649815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:49.650375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:49.650798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:49.733851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.743596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.745056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.746347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-041cb315-abc0-490e-ba39-c84d4b845dbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169803 Sep 06 12:14:49.746930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1809/3657] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:49.792300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:49.801970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bfcf11be-93fd-4126-b5de-42b040b9278b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164705 Sep 06 12:14:49.802569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1849/3658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:50.119741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:50.120280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:50.126523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.127011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.127451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.128156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.128613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.129530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.184736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:50.185307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:50.192010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.192556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.193187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.193782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.194249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.194682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.267844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.277520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fc95a604-fced-4330-8a5e-70555cf84dbf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161489 Sep 06 12:14:50.277971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1810/3659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:50.332298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.333838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:50.334956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:50.340886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.341375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.341763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7fb8345e-cb73-41fe-8830-d5231549577c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160722 Sep 06 12:14:50.341888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.342498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1850/3660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:50 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:50.342668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.343114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.343607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.480630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.489312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b7f5d62d-0ad3-4d01-90de-e9f8975f6449 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159653 Sep 06 12:14:50.489906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1811/3661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:50.773044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:50.773571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:50.780400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.780879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.781309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.782008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.782462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.782879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.828434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:50.829052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:50.835515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.836001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.836445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.837150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:50.837606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:50.838061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:50.924798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.934201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.935718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.936881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-10bd4eb0-5efd-4f63-a144-1f54f079f0a6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168064 Sep 06 12:14:50.937439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1851/3662] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:50.981968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:50.995589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ec58939e-0f31-4419-b59c-46acfefd4ae6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.170823 Sep 06 12:14:50.996184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1812/3663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:51.300502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:51.301131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:51.307195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.307682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.308124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.308817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.309277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.309737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.365511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:51.366162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:51.372343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.372823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.373253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.374038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.374490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.374942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.443417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:51.451787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-db1adf8b-bac8-46c4-9a93-8e70cd90e376 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155174 Sep 06 12:14:51.452372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1852/3664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:51.511118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:51.513688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:51.514316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:51.520290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e9d6d02-a4a7-44dc-a962-97d50783b5b8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159158 Sep 06 12:14:51.521190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1813/3665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:51 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:51.521283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.521837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.522278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.522988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.523446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.523908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.666971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:51.675726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aaf2555c-4e64-46a7-8cfc-94350bec48e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165687 Sep 06 12:14:51.676421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1853/3666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:51.963213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:51.963826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:51.970516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.971005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.971441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:51.972213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:51.972776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:51.973668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.019271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:52.020017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:52.026820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.027315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.027757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.028493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.028954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.029384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.115783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.125073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.126571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.127768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a9b3978-937c-4c01-97e8-0d0f18e0cf0f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168548 Sep 06 12:14:52.128531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1814/3667] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:52.166196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.174648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5c0f27c5-a520-4969-808e-719e1c0be978 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159286 Sep 06 12:14:52.175224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1854/3668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:52.476851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:52.477495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:52.483668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.484150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.484586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.485278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.485767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.486193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.544460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:52.545123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:52.552215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.552788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.553224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.553957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.554410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.554823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.621992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.630131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b74e1e9f-d4d1-4fb4-8ea8-3fe8881040c0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157658 Sep 06 12:14:52.630716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1815/3669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:52.688947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.698266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6a5ca65-748a-4ee1-bd1d-2cf650eeefaa tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157661 Sep 06 12:14:52.698863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1855/3670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:52 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:52.700167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:52.700823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:52.707434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.708530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.708966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.709689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:52.710147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:52.710572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:52.849234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:52.857353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-507cf686-5996-46bb-bb8c-80dd89360ce6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161224 Sep 06 12:14:52.857959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1816/3671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:53.154453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:53.155011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:53.161945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.162438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.162880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.163583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.164043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.164472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.198361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:53.198980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:53.205575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.205997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.206430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.207989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.208458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.208899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.300369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:53.309376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:53.310989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:53.312103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24adf490-f5c5-4efd-8db5-8b7ec07e9ff7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162071 Sep 06 12:14:53.313043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1856/3672] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:53.341178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:53.350193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1f5db40f-3adc-4f21-a9d2-267eecbc783d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155656 Sep 06 12:14:53.350778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1817/3673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:53.653065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:53.653706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:53.659818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.661071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.661534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.662258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.662716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.663149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.723469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:53.724215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:53.730336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.730888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.731322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.732029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.732474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.732911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.798473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:53.806857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed71dd09-e026-4577-bd27-6def8e532c6c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157867 Sep 06 12:14:53.807439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1857/3674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:53.867685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:53.876139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31b996e5-249a-42bf-a329-a498359935da tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157519 Sep 06 12:14:53.876721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1818/3675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:53 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:53.881405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:53.882058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:53.888377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.888870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.889312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:53.890047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:53.890509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:53.890965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.030339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:54.038747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d101105e-2328-42bc-8b42-e7de946559a8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162248 Sep 06 12:14:54.039316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1858/3676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:54.338613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:54.339250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:54.345661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.346155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.346593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.347283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.348152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.348587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.373672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:54.374391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:54.381707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.382218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.382657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.383370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.383831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.384260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.499152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:54.508964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:54.510473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:54.511653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bae20a44-3d20-4b49-9ca6-6749a29f3fcf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.176934 Sep 06 12:14:54.512218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1819/3677] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:54.525240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:54.533839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-74ccdf3d-a36a-4677-8349-eade4cb0e434 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164094 Sep 06 12:14:54.534410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1859/3678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:54.831546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:54.832135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:54.838233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.838712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.839149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.839841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.840298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.840729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.856066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:54.900835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:54.901735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:54.907630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.908121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.908554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.909245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:54.909721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:54.910681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:54.915713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:54.975629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:54.984175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-79375ac9-decb-411a-9a0a-92853e74107b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156255 Sep 06 12:14:54.984767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1820/3679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:55.045404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:55.054889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-54915ace-022a-4845-adcd-31a9212a1d4d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157903 Sep 06 12:14:55.055500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1860/3680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:54 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:55.065025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:55.065768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:55.071974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:55.072459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:55.072901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:55.073615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:55.074099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:55.074526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:55.223324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:55.233338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d169aa4f-791e-4747-b2a9-abed667ac896 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.173766 Sep 06 12:14:55.233953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1821/3681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:55 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:55.537507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:55.538157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:55.544833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:55.545330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:55.545804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:55.546528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:55.546981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:55.547416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:55.557673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:55.558295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:55.564614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:55.565104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:55.565540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:55.566273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:55.567530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:55.567963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:55.701575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:55.709979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-65a920a5-3621-45af-a33a-8b27ef594c52 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.156050 Sep 06 12:14:55.710563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1822/3682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:55.754590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:55.763897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:55.765369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:55.766604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6728e28-b214-4b18-a2c0-952a97a1425f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.233080 Sep 06 12:14:55.767166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1861/3683] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:14:56.008069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:56.008674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:56.014557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.015038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.015465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.016142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.016586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.017005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.079637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:56.080375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:56.086496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.086985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.087420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.088108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.088554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.088970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.154868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.164161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d81c3567-7f21-4a1b-aad5-7784dddf32ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160460 Sep 06 12:14:56.164729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1823/3684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:56.229760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.237139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-56c50890-cfe6-4365-9be4-06b82080d7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161295 Sep 06 12:14:56.237750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1862/3685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:56 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:56.256451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:56.257071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:56.263343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.263715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.264155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.264856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.265324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.265785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.399059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.409029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-085006cd-174b-43ad-9c1e-39a806e1c3a1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156119 Sep 06 12:14:56.409614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1824/3686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:56.734659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:56.735266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:56.741569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.742099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.742532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.743232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.743681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.744096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.793186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:56.793734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:56.800271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.800780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.801229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.801959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:56.802418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:56.802861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:56.884794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.895331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f223e54-f8cf-41ab-9b72-9694bfcda548 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163054 Sep 06 12:14:56.895987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1863/3687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:56.955945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.966270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.968021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:56.969299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c8d952d8-0525-4baa-a564-d6ba904eb72c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.180191 Sep 06 12:14:56.969899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1825/3688] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:14:57.188263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:57.188815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:57.196155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.196642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.197072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.197800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.198268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.198688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.263843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:57.265114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:57.272175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.272673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.273119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.273857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.274320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.274752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.338179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:57.346706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd790124-66c5-4b5d-a665-7fd51d1c9e49 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162402 Sep 06 12:14:57.347293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1864/3689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:57.421823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:57.430990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5c589f7e-48b1-48ec-af80-2ccb37ad2ab3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.171688 Sep 06 12:14:57.431538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1826/3690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:57 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:57.433285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:57.433853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:57.440545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.440962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.441999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.442789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.443239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.443659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.573315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:57.581515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c73da1fd-cdba-40dd-b1fd-66350e75daeb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152270 Sep 06 12:14:57.582132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1865/3691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:57.919192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:57.919801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:57.928024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.928510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.928949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.929669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:57.930125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:57.930549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:57.995082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:57.995762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:58.002343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.002823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.003255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.003982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.004643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.005225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.074911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.083474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c05f252-a143-4cca-9e64-2fd94da78cb7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.168089 Sep 06 12:14:58.084068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1827/3692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:58.143148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.152283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.153762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.154940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d6309bf5-c0aa-45f4-b945-ee4d3abf6fb3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163799 Sep 06 12:14:58.155502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1866/3693] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:14:58.371567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:58.372178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:58.378653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.379199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.379773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.380499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.380983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.381408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.517806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.522540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:58.523165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:58.526163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5418052a-6450-45dc-b22b-ef028c9ae0f0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158398 Sep 06 12:14:58.527000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1828/3694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:58.529463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.530094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.530535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.531231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.531686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.532110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.604972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:58.605596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:58.611517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.612013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.612453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.613214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:58.614652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:58.614806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:58.666650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.675010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3883809f-1b99-4a05-a16f-cb95242d8aff tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.223857 Sep 06 12:14:58.676456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1867/3695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:58 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:58.745865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:58.753955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41a1ec95-7167-4be6-a7b0-4ae8a7d82a2a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152828 Sep 06 12:14:58.754677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1829/3696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:59.107245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:59.107971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:59.114823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.115366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.115824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.116545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.117003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.117430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.180908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:59.181549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:59.189031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.189709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.190135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.190830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.191790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.192462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.258716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.267328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1abf705d-96a1-4cef-bd72-774a73d834fa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164127 Sep 06 12:14:59.268133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1868/3697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:59.328022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.337698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.339141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.340306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b69f24c-632e-4c84-a433-a49dc57017a7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163629 Sep 06 12:14:59.340888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1830/3698] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:14:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:14:59.552462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:59.553075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:59.559275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.559761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.560298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.561054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.561532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.562083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.698988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:59.699611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:59.704864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.705800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.706292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.706788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.707553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.708015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.708447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.713668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7369df46-8249-4645-a6fa-c7e1e1ec2827 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165658 Sep 06 12:14:59.714251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1869/3699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:14:59.777100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:14:59.777974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:14:59.786317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.786994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.787258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.788154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:14:59.788772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:14:59.789516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:14:59.844685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.853785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-432348ec-4c1e-4856-bc73-52d4be73958f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158631 Sep 06 12:14:59.854372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1831/3700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:59 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:14:59.939233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:14:59.948673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc9c04c2-558d-4f69-bbb8-ff8482db43de tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175771 Sep 06 12:14:59.949262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1870/3701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:14:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:00.292421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:00.293029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:00.299987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.300268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.300719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.301418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.301908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.302338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.366791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:00.367545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:00.374190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.374687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.375131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.375844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.376301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.376728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.442359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:00.451731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-18379914-eeb5-428c-95bb-90e6ca530aa9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163022 Sep 06 12:15:00.452683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1832/3702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:00.542315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:00.552231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:00.553911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:00.555104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8ac511c1-e1e4-469b-a1e5-35be5e07c435 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.192963 Sep 06 12:15:00.555668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1871/3703] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:00.737202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:00.737844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:00.744633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.745131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.745561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.746280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.746739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.747167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.877392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:00.878031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:00.882701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:00.884482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.884964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.885396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.886121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.886679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.886996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.891285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-43992606-8f23-4a07-a491-a4f1b5bb39e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157918 Sep 06 12:15:00.891882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1833/3704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:00.971780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:00.972389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:00.979272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.979753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.980181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:00.980925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:00.981371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:00.981822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:01.021625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:01.030547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-02c9ea1c-c234-46b8-8f9a-5b3897fa2341 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157011 Sep 06 12:15:01.031238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1872/3705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:00 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:01.116870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:01.125276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-df1ae7b0-e60d-4aa3-8f82-3080f6d297e6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157368 Sep 06 12:15:01.125896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1834/3706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:01.477389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:01.478294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:01.485433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:01.485967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:01.486413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:01.487131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:01.487598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:01.488031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:01.585018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:01.586095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:01.594688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:01.595614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:01.596287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:01.597242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:01.598065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:01.598849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:01.636570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:01.646044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e71d585-85c8-4c3e-a4d0-9783a187bd39 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173435 Sep 06 12:15:01.646661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1873/3707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:01.736490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:01.745861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:01.747303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:01.748475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9eb41675-e9ab-4c11-997c-5f4db48e9cbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.170632 Sep 06 12:15:01.749039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1835/3708] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:01.914712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:01.915336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:01.921618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:01.922143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:01.922588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:01.923293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:01.923760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:01.924185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.054247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:02.054851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:02.059616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.062382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.062873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.063316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.064021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.064596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.064900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.068381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9d23f367-7228-42f8-8a4b-0cd7204d542e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157642 Sep 06 12:15:02.068968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1874/3709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:02.148440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:02.149067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:02.155596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.156103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.156555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.157380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.157876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.158310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.204802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.213357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-783199c0-cc5d-48d9-ac47-778b44b91184 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162927 Sep 06 12:15:02.213993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1836/3710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:02 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:02.308848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.317258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a9e8bc81-80e9-452d-ba91-8625d1eef07d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172851 Sep 06 12:15:02.317875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1875/3711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:02.669975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:02.670630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:02.677405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.677935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.678984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.679791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.680255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.680684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.683706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:02.774639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:02.775254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:02.781995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.782609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.782920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.783616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:02.784063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:02.784487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:02.821257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.829736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b1ce812e-f7b0-48c2-9615-ab7ac4af5444 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163546 Sep 06 12:15:02.830305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1837/3712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:02.921319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.923648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:02.932303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.933799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:02.935014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-424040b9-3932-4c92-b460-22857914ef45 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164289 Sep 06 12:15:02.935563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1876/3713] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:03.091968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:03.092555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:03.098590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.099074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.099509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.100700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.101159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.101780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.236455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:03.237398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:03.240066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:03.243707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.244279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.244733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.246428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.246428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.246428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.249408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6bab11e5-92dd-4f65-9998-b9f32fa12c9a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161428 Sep 06 12:15:03.250037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1838/3714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:03.340741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:03.341350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:03.347509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.347919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.348347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.349039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.349489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.349947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.386273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:03.395201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-97f7b198-cdaa-48a2-bf69-69a16fc748d4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162566 Sep 06 12:15:03.395804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1877/3715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:03 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:03.484286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:03.492600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-18bed5f2-0c4d-4a7b-9a52-76bfdffaa864 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155562 Sep 06 12:15:03.493178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1839/3716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:03.854532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:03.855143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:03.861947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.862436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.862872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.863570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.864429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.864429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.961667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:03.962313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:03.968661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.969142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.969576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:03.970309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:03.970758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:03.971183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.002427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.012281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bcf17a17-3ac6-49cc-8e95-532075a15432 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162115 Sep 06 12:15:04.012909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1878/3717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:04.108434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.117047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.118517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.119729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2083d64b-6b3a-4676-8d88-22b020980e6b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163085 Sep 06 12:15:04.120292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1840/3718] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:04.273106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:04.273684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:04.275580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:04.281094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:04.281580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:04.282044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.282756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:04.283202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:04.283626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.420029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.421050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:04.421726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:04.429025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:04.429467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a7b84bd-a732-4f0e-b999-9cca20ac0284 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160940 Sep 06 12:15:04.429595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:04.429960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.441755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1879/3719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:04.441965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:04.441965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:04.441965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.516517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:04.517093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:04.524187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:04.524678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:04.525112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.525841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:04.526301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:04.527113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:04.580015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.590587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a495db80-f37e-4a92-b2c8-1868a22155e3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.174122 Sep 06 12:15:04.591171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1841/3720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:04 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:04.669156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:04.677579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6fc0d60-508f-479a-8d66-364d96123dad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165049 Sep 06 12:15:04.678708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1880/3721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:05.036825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:05.038012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:05.044953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.045446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.045891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.046589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.047042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.047463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.144647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:05.145331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:05.152851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.153350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.153827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.154544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.155007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.155441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.188881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.197962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-212427b0-e72f-44d7-9cc3-18245dcf4020 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164857 Sep 06 12:15:05.198556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1842/3722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:05.296082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.305671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.307113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.308287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dcdb7a9b-bffa-4e21-bb8e-4a11d14ff060 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167587 Sep 06 12:15:05.308872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1881/3723] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:05.454815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:05.455421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:05.457229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:05.463717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.464212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.464635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.465330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.465812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.466237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.602929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.611281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1978680f-a6d8-455a-9dc9-c7fd95fe748a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160298 Sep 06 12:15:05.611860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1843/3724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:05.614328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:05.614977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:05.621437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.621953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.622390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.623112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.623530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.623967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.700926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:05.701535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:05.707681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.708168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.708597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.709360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:05.709840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:05.710413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:05.764423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.781358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af47d89f-bb12-4df4-8bae-1d4329f50183 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170662 Sep 06 12:15:05.782585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1882/3725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:05 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:05.854553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:05.862876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2d88d17d-431d-453c-a602-de5de7a3a817 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165729 Sep 06 12:15:05.863454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1844/3726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:06.221555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:06.222197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:06.230596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.231095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.231539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.232255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.232740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.233158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.333426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:06.334070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:06.340976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.341474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.341948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.342651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.343104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.343536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.378685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:06.387634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef868302-8797-4482-b609-85e4d06200de tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169966 Sep 06 12:15:06.388235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1883/3727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:06.482604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:06.491360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:06.492846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:06.494018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-deb3d058-fff4-4610-90ff-6d4a796c1bb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164478 Sep 06 12:15:06.494615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1845/3728] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:06.634445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:06.635074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:06.641242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.641769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.642214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.642921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.643383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.643813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.782630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:06.791283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0ec33d4f-d19d-4aeb-9277-7311bcee923d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161164 Sep 06 12:15:06.791859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1884/3729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:06.806194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:06.806949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:06.813403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.813941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.814384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.815109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.815566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.815995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.898039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:06.898039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:06.904613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.905515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.906349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.916896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:06.917576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:06.918132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:06.966705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:06.975686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1e888842-e1d8-4a8e-80be-c1b90e28bb23 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.173077 Sep 06 12:15:06.976418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1846/3730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:06 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:07.058991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:07.067413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-369cf697-28c4-4846-97f9-070bd8db499c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183285 Sep 06 12:15:07.067995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1885/3731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:07.411922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:07.413037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:07.419810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:07.420300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:07.420737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:07.421441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:07.421927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:07.422359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:07.521476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:07.522311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:07.530372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:07.530874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:07.531318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:07.532028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:07.532484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:07.532915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:07.570384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:07.579054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dedc4718-9a6e-427b-9dec-4367295a6a0a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.170980 Sep 06 12:15:07.579665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1847/3732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:07.673583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:07.683438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:07.684878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:07.686089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1072db09-22c2-428f-97b6-c6c0967d7192 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169308 Sep 06 12:15:07.686668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1886/3733] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:07.814867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:07.815470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:07.821800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:07.822288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:07.822721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:07.823430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:07.823862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:07.824405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:07.962765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:07.971196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-48936196-824d-4ebe-ae71-af548c674063 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160288 Sep 06 12:15:07.971766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1848/3734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:08.000566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:08.001201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:08.008460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.008966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.009417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.010194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.010667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.011102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.091423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:08.092035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:08.098117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.098601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.099110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.099823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.100345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.100778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.151750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:08.160143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-14265a2c-96ef-4a41-8e59-59ab0fc8d958 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.163665 Sep 06 12:15:08.160913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1887/3735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:07 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:08.233226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:08.241929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22a9e368-12af-412a-94fd-983fa1a78697 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154161 Sep 06 12:15:08.242521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1849/3736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:08.602689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:08.603481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:08.610363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.610969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.611299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.612012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.612468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.612895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.712435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:08.713276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:08.719645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.720124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.720552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.721240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:08.721705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:08.722130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:08.747813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:08.756916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5ad10d34-4cd8-4e24-b432-945ffacdea66 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157570 Sep 06 12:15:08.758017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1888/3737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:08.856081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:08.864475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:08.866714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:08.867902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-024d2144-0620-4fae-9b4d-681dd1364b44 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159387 Sep 06 12:15:08.868645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1850/3738] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:09.054510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:09.055141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:09.061077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.061551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.062013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.062693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.063159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.063576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.184171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:09.184791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:09.191793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.192699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.193166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.194823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.195329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.195763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.197662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:09.206322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b8ea40b2-b137-4564-9378-da0ac0f318fa tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156368 Sep 06 12:15:09.206902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1889/3739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:09.265246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:09.265883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:09.272218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.272705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.273172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.273881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.274332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.274752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.330315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:09.339173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32138586-ebed-4885-8db5-d0e72facc8b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.159153 Sep 06 12:15:09.339917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1851/3740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:09 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:09.410356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:09.419449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-223145e0-778c-412d-a010-836a8e138cd8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158039 Sep 06 12:15:09.420016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1890/3741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:09.780275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:09.781401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:09.787028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.787540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.787984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.788692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.789399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.789868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.895140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:09.895914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:09.904411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.905056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.905605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.906496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:09.907069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:09.907609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:09.952130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:09.961032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb5296a8-a71d-44bf-9caa-7c85003bf127 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.184862 Sep 06 12:15:09.961627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1852/3742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:10.043779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:10.053871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:10.055368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:10.056554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6c44c3d-99a0-418f-b3f7-1ce4b0e0b90c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165955 Sep 06 12:15:10.057177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1891/3743] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:10.230150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:10.230771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:10.238296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.238803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.239243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.239963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.241006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.241503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.362054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:10.362565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:10.369440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.369967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.370411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.371114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.371678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.371999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.383249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:10.385445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:10.393088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-725b6f29-1253-4ebd-aa59-26b74b6488dc tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.167069 Sep 06 12:15:10.393700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1853/3744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:10.443120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:10.443963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:10.449854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.450335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.450762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.451470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.451892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.452308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.508122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:10.516449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae88ec87-a156-4105-b3b5-8c0239f0ec5c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158327 Sep 06 12:15:10.517029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1892/3745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:10 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:10.586964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:10.594993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dd8aaa16-a5b2-464e-83a5-d11d6a0aec38 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155729 Sep 06 12:15:10.595585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1854/3746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:10.984613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:10.985281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:10.992490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.992982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.993427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:10.994181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:10.994639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:10.995070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.011203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:11.082141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:11.082753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:11.090043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.090569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.090955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.091642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.092103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.092504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.136441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.145347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-91fcd678-dd4a-4be2-8bad-9f60193ab437 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164647 Sep 06 12:15:11.150144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1893/3747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:11.226880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.235911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.237277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.238452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6671b30d-d4bc-470c-963d-6bd8fec617e6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160240 Sep 06 12:15:11.239016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1855/3748] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:11.416653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:11.417263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:11.423303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.423786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.424227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.424918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.425378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.425849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.541569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:11.542162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:11.550086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.550572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.551007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.551708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.552161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.552582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.556365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.564627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a89c67ad-a65c-4274-a538-e467cf7a2e3b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151997 Sep 06 12:15:11.565218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1894/3749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:11.619791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:11.620415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:11.626416 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.626848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.627288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.627987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:11.628446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:11.628874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:11.693061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.702187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4343bf83-6ecd-46ab-b935-7d23d396a509 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.166073 Sep 06 12:15:11.702770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1856/3750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:11 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:11.767226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:11.776407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b937b7b8-b93b-4db1-8fc6-1c2ff25d8d73 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161481 Sep 06 12:15:11.777254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1895/3751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:12.171172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:12.172080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:12.180274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.180767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.181207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.181944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.182409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.182833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.264760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:12.265854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:12.272769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.273348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.273872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.274625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.275086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.275497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.324803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:12.332933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f894e5c1-8f66-4c3c-a1dd-00590ad224b5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166187 Sep 06 12:15:12.333510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1857/3752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:12.409851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:12.419209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:12.420627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:12.421986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a167b56f-cc8f-4072-868c-73da1f493fbb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161181 Sep 06 12:15:12.422488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1896/3753] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:12.589239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:12.589883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:12.595877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.596359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.596800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.597489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.597986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.598416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.725853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:12.726544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:12.730527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:12.732776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.733254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.733705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.734395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.734845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.735262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.739077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a101cfe4-155a-48b6-bd85-60a3c83bbf8b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154552 Sep 06 12:15:12.739656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1858/3754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:12.800415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:12.801042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:12.807882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.808370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.808817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.809519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:12.810004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:12.810431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:12.881869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:12.890862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-81d5f021-7eeb-4a0d-abd7-2ea440dc4def tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168894 Sep 06 12:15:12.891585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1897/3755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:12 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:13.095510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:13.103877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3bf17b94-cd90-4f26-9a41-9976f103560d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.307417 Sep 06 12:15:13.104448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1859/3756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:13.357501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:13.358091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:13.364671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.365158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.366229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.367046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.367508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.367940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.447724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:13.448528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:13.454637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.455119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.455750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.456444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.456905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.457327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.505841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:13.514413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb77becd-c7d4-495a-9660-2f715909dab3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160925 Sep 06 12:15:13.515006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1898/3757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:13.591041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:13.599483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:13.601617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:13.602803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4c433a2b-d98e-4d89-81d1-bdf4ee97bf37 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159074 Sep 06 12:15:13.603342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1860/3758] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:13.762515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:13.763168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:13.768984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.769471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.769942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.770622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.771071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.771489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.912484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:13.915832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:13.916444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:13.921741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a7170db-0b78-4fba-a924-0a91c3af8be6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163038 Sep 06 12:15:13.922416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.922557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1899/3759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:13.922895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.923331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:13.924053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:13.924494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:13.924906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.060500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:14.069354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f37b709b-e0f6-43fd-8fa3-494806f9d0c7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157593 Sep 06 12:15:14.069964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1861/3760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:13 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:14.128158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:14.128804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:14.136235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.136864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.137393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.138268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.138951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.139470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.283785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:14.292987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ad2240c6-99b2-4e6c-80b3-3738cc61b6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168639 Sep 06 12:15:14.293569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1900/3761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:14 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:14.538227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:14.538843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:14.545429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.546368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.546368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.547110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.547535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.547964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.628548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:14.629230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:14.637335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.637886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.638467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.639344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.639898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.640403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.689077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:14.698957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7413475a-18ff-4c69-a900-2a329e5f213f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164922 Sep 06 12:15:14.699600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1862/3762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:14.778325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:14.786878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:14.788884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:14.790098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b975608-3ed8-46e6-a2e7-84dc411d157f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165587 Sep 06 12:15:14.790667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1901/3763] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:14.947491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:14.948105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:14.954106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.954585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.955023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:14.955706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:14.956159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:14.956613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.092657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.093840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:15.094840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:15.101439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.101965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.102078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-059e4608-b71a-4b77-beb9-9b5afbaf9ad1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159391 Sep 06 12:15:15.102408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.102802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1863/3764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:15.103108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.103569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.104007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.247367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.255767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-02b59930-fa24-4b4b-84fd-a8823acce9f6 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165947 Sep 06 12:15:15.256671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1902/3765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:15 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:15.315759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:15.316373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:15.323927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.324435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.324876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.325609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.326093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.326528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.468423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.478697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7befe2bd-4f00-4b01-9bab-f5a75e165f0d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166780 Sep 06 12:15:15.479302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1864/3766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:15.722782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:15.723393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:15.730000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.730482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.730913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.731599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.732054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.732473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.816389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:15.817037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:15.825205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.825716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.826157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.826866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:15.827324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:15.828008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:15.875892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.885713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-532fd900-b7b2-456b-9a47-9b10f017073a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167677 Sep 06 12:15:15.886322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1903/3767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:15.986481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.996166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.997662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:15.998890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5a1a7864-0f28-4200-a4b9-1e7c7fed8e11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.186434 Sep 06 12:15:15.999460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1865/3768] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:16.126734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:16.127252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:16.133786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.134495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.135039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.135970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.136693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.137176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.280377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:16.281452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:16.287181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.287725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.287880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:16.288949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.289240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.289705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.290138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.297121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-03f697cc-9ed8-4fb6-a562-0b8acd2f6512 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.174430 Sep 06 12:15:16.297753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1904/3769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:16.441919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:16.457883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-02fe88b8-5d46-44b5-9fbf-c886c5459aa2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.181532 Sep 06 12:15:16.458975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1866/3770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:16 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:16.504598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:16.505226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:16.512558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.513050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.513499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.514269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.514734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.515165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.652113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:16.660876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09d6a3d2-aa3a-44f3-abaa-c128a24df654 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160141 Sep 06 12:15:16.661507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1905/3771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:16.919239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:16.919892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:16.926376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.926860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.927296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:16.928549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:16.929015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:16.929464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.024783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:17.025522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:17.032291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.032864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.033313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.034047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.034510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.034941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.061327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.070594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b7cc4fb-be45-471a-8d43-0bdc0aca83a8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155044 Sep 06 12:15:17.071086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1867/3772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:17.166433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.175601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.177006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.178867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc8a24c4-d274-4902-9891-6a8e9157c2fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157529 Sep 06 12:15:17.179434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1906/3773] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:17.320287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:17.320919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:17.327018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.327512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.327953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.328657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.329117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.329575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.460079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.468363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aa6e0cb5-5235-44ea-9eaa-a78d845109c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151929 Sep 06 12:15:17.468944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1868/3774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:17.487515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:17.488132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:17.495003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.495490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.495931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.496617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.497073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.497496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.632865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.641210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9a9fb9a8-7ccb-413a-b831-4527e1cc5b56 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.157509 Sep 06 12:15:17.641822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1907/3775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:17 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:17.684489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:17.685107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:17.691261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.691747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.692187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.692874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:17.693329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:17.693817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:17.827709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:17.837067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a06d1c9d-268e-4349-ab00-07d0cb3274a4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156442 Sep 06 12:15:17.837660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1869/3776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:18.094910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:18.095437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:18.102442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.102933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.103376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.104068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.104531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.104963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.203750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:18.204402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:18.211336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.211820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.212263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.212967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.213425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.213889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.230090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:18.238139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:18.246769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c75e7644-97e2-42f0-9c0b-2f4c2eac941b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155769 Sep 06 12:15:18.247399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1908/3777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:18.347855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:18.357042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:18.358502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:18.359652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-347d92fa-70f0-4599-913e-c6a08c71af56 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159786 Sep 06 12:15:18.360206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1870/3778] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:18.493570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:18.494226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:18.500205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.500691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.501133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.501873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.502332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.502756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.643488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:18.652678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-584a97fa-6f85-42c5-8f4d-0c16c91ef8c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163547 Sep 06 12:15:18.653251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1909/3779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:18.666487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:18.667138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:18.672957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.673436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.673913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.674600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.675051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.675473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.808471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:18.816613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c6b9a9a-f621-49c6-a9e5-905487b4707a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.155143 Sep 06 12:15:18.817180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1871/3780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:18 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:18.860922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:18.861453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:18.868183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.868669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.869099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.869823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:18.870273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:18.870692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:18.875935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:19.003544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:19.012989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3694973-8dc4-42cd-a426-9fd8878caeaf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156000 Sep 06 12:15:19.013596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1910/3781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:19.270319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:19.270967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:19.278371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.278853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.279287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.279969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.280421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.280845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.385213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:19.385951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:19.392687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.393150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.393586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.394317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.394775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.395335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.416011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:19.424734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ceee0223-6e04-4d7e-8ba7-6d0b8a4e7ca8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158217 Sep 06 12:15:19.425325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1872/3782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:19.534143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:19.543449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:19.544887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:19.546085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-30051182-2d56-49e3-b0cf-6b9fd3638158 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165088 Sep 06 12:15:19.546649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1911/3783] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:19 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:19.675961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:19.676571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:19.682722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.683213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.683648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.684340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.684789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.685205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.815663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:19.825688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a89d737b-f09b-49e6-bda0-09274ded55e9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153492 Sep 06 12:15:19.826279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1873/3784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:19.840793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:19.841501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:19.847969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.848535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.848975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.849700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:19.850757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:19.851181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:19.997315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:20.006452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99ad04c4-178a-4fe4-8019-693c3100d4b3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.168852 Sep 06 12:15:20.007066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1912/3785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:19 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:20.036998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:20.038386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:20.044723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.045213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.045676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.046420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.046967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.047276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.197433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:20.206206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-911ce044-9697-46b4-adb8-d0e88943ee17 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.173178 Sep 06 12:15:20.206796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1874/3786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:20 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:20.450090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:20.450751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:20.457521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.458053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.458496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.459640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.460206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.460645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.572890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:20.573499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:20.580304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.580795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.581230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.581961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.582419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.582842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.598547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:20.607691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-941cb9f0-c773-4ae1-b12d-2cbd6eb7fc2c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161770 Sep 06 12:15:20.608283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1913/3787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:20 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:20.727114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:20.736327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:20.737827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:20.739020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52a8b95f-d4fe-4f68-850e-e7af57923c59 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.170907 Sep 06 12:15:20.739594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1875/3788] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:20.852499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:20.853162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:20.859627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.860119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.860560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:20.861278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:20.861776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:20.862203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.010441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.018994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0fc1cb56-c7e7-4094-ab4a-177ef4436624 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.171999 Sep 06 12:15:21.019592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1914/3789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:21.030964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:21.031622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:21.038548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.039047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.039491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.040218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.040679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.041105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.186546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.195704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5741c466-46b9-4763-82d0-47bf39800187 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.169013 Sep 06 12:15:21.196296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1876/3790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:21 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:21.229958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:21.230579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:21.236645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.237131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.237568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.238301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.238755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.239177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.384573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.392934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9b8eb091-b6a5-455c-ade4-90531b3a9685 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167003 Sep 06 12:15:21.393515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1915/3791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:21.631872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:21.632744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:21.639491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.639982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.640415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.641121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.641578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.642052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.766597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:21.767221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:21.773971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.774433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.774827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.775260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.775963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:21.776417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:21.777090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:21.783135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f440a501-a7b7-45a0-b553-2034572ab1fc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155138 Sep 06 12:15:21.784312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1877/3792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:21.919181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.928441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.930090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:21.931311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c98b9abf-1505-4f5e-86fc-cbc746c8f36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168608 Sep 06 12:15:21.931882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1916/3793] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:22.043962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:22.044577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:22.051254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.051745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.052187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.052932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.053388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.053854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.189991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:22.198874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d58e7b9-5dbe-49dd-9abe-1f99cdda6749 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158758 Sep 06 12:15:22.199452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1878/3794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:22.218340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:22.218959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:22.225567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.226077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.226512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.227205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.227657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.228110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.368927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:22.377266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5327ec0c-8d59-4a10-8f92-6ef43b66595c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162753 Sep 06 12:15:22.377874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1917/3795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:22 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:22.418724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:22.419340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:22.425443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.425968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.426407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.427099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.427556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.428176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.570708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:22.579284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-502d4aef-5f2a-495c-a60e-6394b1440350 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164290 Sep 06 12:15:22.579872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1879/3796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:22.808233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:22.808747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:22.815234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.815715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.816144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.816828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.817276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.817723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.955407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:22.957629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:22.958274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:22.963848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-61aa55f1-94f9-4044-b43c-eadb3b254067 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159512 Sep 06 12:15:22.964432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1918/3797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:22.965174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.965686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.966128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:22.966859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:22.967319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:22.967746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.102400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:23.111023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:23.112474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:23.113668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2fbbafe6-ac41-4fce-9506-42eca0925a2d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160018 Sep 06 12:15:23.114234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1880/3798] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:23.223151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:23.223823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:23.230421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:23.230909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:23.231350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.232044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:23.232502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:23.232931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.369942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:23.378377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e46981c-5228-4fd0-b9d4-e7a3e1707f22 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159111 Sep 06 12:15:23.378955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1919/3799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:23.401372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:23.402291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:23.408261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:23.408738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:23.409167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.409881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:23.410328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:23.410746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.550290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:23.559612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6acb990d-bc1d-42bb-88de-4bc424223326 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.162866 Sep 06 12:15:23.560206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1881/3800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:23 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:23.604263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:23.604893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:23.611291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:23.611799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:23.612286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.613027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:23.613483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:23.613942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:23.746273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:23.754449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c7553e63-830d-4b0b-bb80-7775193533ae tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154745 Sep 06 12:15:23.755013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1920/3801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:23.990326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:23.991435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:24.007923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.008420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.008860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.009570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.010064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.010493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.139094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:24.139700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:24.144694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.146554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.147725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.148172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.148891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.149350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.149819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.153833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-336af2f2-0c8a-44d5-9394-f75c263efd03 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167561 Sep 06 12:15:24.154434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1882/3802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:24.300264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.310657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.312117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.313323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-82e2ac25-debf-4166-999d-64dd9abca248 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.178275 Sep 06 12:15:24.313949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1921/3803] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:24 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:24.402036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:24.402662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:24.408909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.409404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.409877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.410582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.411045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.411480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.550848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.560105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-18bd8127-9862-40ac-9247-1ef380f7f56b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162574 Sep 06 12:15:24.560685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1883/3804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:24.583405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:24.584140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:24.590253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.590745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.591189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.592001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.592471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.592911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.727295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.735741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b2c9a96c-8055-4c8e-bcd4-3cdcf188cff7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156099 Sep 06 12:15:24.736323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1922/3805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:24 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:24.779238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:24.779779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:24.786076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.786573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.787018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.788268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:24.788934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:24.789371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:24.927332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:24.936771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9ed697d-97eb-40ad-9888-bcca7d8c3c9c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162832 Sep 06 12:15:24.937368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1884/3806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:25.176330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:25.176947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:25.183683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.184156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.184588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.185299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.185772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.186192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.324912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:25.333242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-92eda165-7c0b-4384-b955-afcd7093d559 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.160732 Sep 06 12:15:25.333844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1923/3807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:25 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:25.340723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:25.341483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:25.347969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.348456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.348894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.349610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.350091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.350530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.480645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:25.489993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:25.491750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:25.492940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8526c437-c5ca-4b5c-b321-5794dfa22db0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156231 Sep 06 12:15:25.493511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1885/3808] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:25.582823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:25.583444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:25.590142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.590631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.591072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.591758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.592220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.592648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.761296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:25.761951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:25.771524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.772028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.773142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.773279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:25.773879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:25.774319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:25.977457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:25.987808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0118874a-1ed9-4a15-aa45-4849f433268b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.408704 Sep 06 12:15:25.988581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1924/3809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:25.994130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:25.994751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:26.002051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:26.002538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:26.003338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:26.003887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:26.004346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:26.004766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:26.150340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:26.161567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4afdc76a-1c17-4edc-a0ae-5348e09fbb53 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.404775 Sep 06 12:15:26.162860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1886/3810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:25 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:26.173081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:26.182911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a274966-6472-4570-86e3-7d3a9404ef6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.193502 Sep 06 12:15:26.183587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1925/3811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:25 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:26.356542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:26.357248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:26.363676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:26.364157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:26.364589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:26.365897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:26.366405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:26.366836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:26.369458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:26.495604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:26.504095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-95070fb6-6d7b-4a01-8895-22146980515a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.151403 Sep 06 12:15:26.504670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1887/3812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:26.522937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:26.523540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:26.529937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:26.530417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:26.530847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:26.531530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:26.531977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:26.532398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:26.678400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:26.680736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:26.688629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:26.690102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:26.691283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6327bf38-64df-4565-9d26-04ed59ebf0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.172790 Sep 06 12:15:26.691850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1926/3813] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:27.014834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:27.015489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:27.022231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.023031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.023213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.023934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.024395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.024841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.161265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.170054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a39f403e-ef1e-4de7-8d4c-627f2bf9630f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160975 Sep 06 12:15:27.170634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1888/3814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:27.192724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:27.193944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:27.200434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.200866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.201300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.202290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.202582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.202985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.206790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:27.207417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:27.214307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.214809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.215289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.216067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.216532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.216960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.348948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.357267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f0792312-7a19-40e5-b6e4-a7a81f55d1e8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.169180 Sep 06 12:15:27.357881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1927/3815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:27 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:27.367173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.375748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d13d8ce-76a8-4360-bb0d-f604703db4d7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172810 Sep 06 12:15:27.376509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1889/3816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:27.528091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:27.528780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:27.536175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.536676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.537694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.538653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.539473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.539888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.685286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.693856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09ee04e3-eadd-4ebe-966e-98dda369b5a9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169851 Sep 06 12:15:27.694536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1928/3817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:27.716828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:27.717262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:27.723344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.723835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.724279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.726265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:27.726735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:27.727171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:27.867617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.876255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.877722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:27.878904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b069153-3314-4c82-a3e4-9810fb868f5e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166287 Sep 06 12:15:27.879462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1890/3818] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:28.195563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:28.196186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:28.198102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:28.203510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.204048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.204490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.205204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.205686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.206124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.349294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:28.358124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7f5d6ae-33e4-4dc8-bdc2-ea4c964ef7c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.167265 Sep 06 12:15:28.358703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1929/3819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:28.380410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:28.381132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:28.383069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:15:28.383213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 (ip 10.222.0.18) !!! Sep 06 12:15:28.389741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.390219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.390697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.391392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.391843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.392268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.399639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:28.400265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:28.406583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.407074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.407516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.408245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.408707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.409136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.529895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:28.538556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a9856ea3-474e-4872-a4d0-36b19073d903 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161908 Sep 06 12:15:28.539145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1891/3820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:28 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:28.548456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:28.557826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bb3e9eea-b5bd-4ad0-b14b-b9038cfb5723 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162206 Sep 06 12:15:28.558409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1930/3821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:28.717796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:28.718425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:28.724713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.725137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.725582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.726333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.726795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.727229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.859637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:28.868946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-10d81f06-6fc6-44f0-9311-3794c9070d60 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155066 Sep 06 12:15:28.869561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1892/3822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:28.906503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:28.907125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:28.913543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.914072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.914524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:28.915217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:28.915680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:28.916114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.053562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:29.062362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:29.063805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:29.064972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ba8e8433-30ee-443e-a93d-d70cae52d9c6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162464 Sep 06 12:15:29.065534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1931/3823] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:29.382593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:29.383247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:29.385750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:29.390963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.391453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.391886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.392583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.393035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.393456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.538272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:29.547164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a64a016-8341-4df9-b63b-80f8347f9245 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.169694 Sep 06 12:15:29.547749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1893/3824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:29.562806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:29.563525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:29.571099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.571699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.572216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.572946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.573413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.573878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.582840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:29.583453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:29.589950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.590439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.590870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.591566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.592014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.592436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.720534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:29.731318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a370c4d9-2529-4689-9884-14e6b1bfebc5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.172318 Sep 06 12:15:29.731927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1932/3825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:29 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:29.767064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:29.776014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1fd4ca1-a59a-4852-8253-76f67176d91c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.198245 Sep 06 12:15:29.776860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1894/3826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:29.893598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:29.894163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:29.900437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.900931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.901366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:29.902362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:29.902819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:29.903247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.048165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:30.057730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a9579fdf-12b4-4663-851d-d1b625b4b651 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.168485 Sep 06 12:15:30.058342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1933/3827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:30.090896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:30.091544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:30.097631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.098149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.098588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.099341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.100930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.101366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.254901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:30.270160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:30.272288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:30.273962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2bc3f319-dc1b-42cd-8889-f3527b62b2b3 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.186777 Sep 06 12:15:30.274656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1895/3828] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:30 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:30.579565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:30.580191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:30.587108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.587598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.588038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.588748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.589209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.589663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.755446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:30.756132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:30.762696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.763184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.763627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.764359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.764819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.765249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.833351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:30.842059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9db1de3-70bc-42da-bec8-993e3608c9d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.266281 Sep 06 12:15:30.842659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1934/3829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:30.847198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:30.847806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:30.860048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.860813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.861446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.862202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:30.862706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:30.863117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:30.904098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:30.913346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5ab639f2-4d4a-457a-8a92-d86945ad6876 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161482 Sep 06 12:15:30.913968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1896/3830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:30 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:31.007369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:31.015959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-770e70b9-e575-42e2-ba55-2e09d8856399 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172276 Sep 06 12:15:31.016547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1935/3831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:31.082108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:31.082729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:31.089428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.089968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.090410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.091108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.091567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.091999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.228601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:31.237427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d937d1cf-281e-4edc-93e8-91ed181da47b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159286 Sep 06 12:15:31.238049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1897/3832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:31.300482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:31.301101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:31.307781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.308286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.308752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.309598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.310199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.310634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.460250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:31.470089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:31.471556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:31.472767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8604e576-e4c8-4d7e-871f-59b9ebe99809 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.176246 Sep 06 12:15:31.473353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1936/3833] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:31.865985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:31.866616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:31.873234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.873764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.874211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.874911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.875368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.875794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.936419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:31.937064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:31.944901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.945406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.945888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:31.946633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:31.947133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:31.947560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.024090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.037587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-56e0a0ca-da89-418c-a96e-095f994fa15f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.175995 Sep 06 12:15:32.038224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1898/3834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:32.044909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:32.045541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:32.052190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:32.052730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:32.053159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.054120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:32.054810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:32.055241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.133379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.142944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6986e11e-b477-4da2-b899-c58bfe163b69 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.210317 Sep 06 12:15:32.145871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1937/3835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:31 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:32.201256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.210212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2422feec-62ff-47e8-8329-da9de712ca19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.170707 Sep 06 12:15:32.210817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1899/3836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:32.262994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:32.263607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:32.269735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:32.270223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:32.270658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.271960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:32.272492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:32.273026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.419659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.429310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ddf3f99b-9fc3-4ad4-b33a-7493aaa6257f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.170056 Sep 06 12:15:32.429946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1938/3837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:32.549845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:32.550544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:32.557446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:32.557970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:32.558412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.559125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:32.559576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:32.560002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:32.703284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.712532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.714025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:32.715226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3d53092a-68ce-4fc3-bbe5-7143cc13f63a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.220716 Sep 06 12:15:32.715798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1900/3838] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:33.063576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:33.064173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:33.071109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.071604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.072046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.072749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.073208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.073635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.168304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:33.168984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:33.175883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.176383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.176828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.177621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.178132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.178566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.219747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.229532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5d7da7ec-7237-4b95-91ee-2b792081b36c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170884 Sep 06 12:15:33.230252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1939/3839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:33.235332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:33.235963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:33.244495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.245696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.246586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.247932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.248788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.249568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.352886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.361410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-96eda336-2907-41cf-bdb6-7e3511e1f1a4 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.196997 Sep 06 12:15:33.362122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1901/3840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:33 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:33.424467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.433947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d4d2e4a-5edf-4178-bfa6-1fd6c250261d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.202396 Sep 06 12:15:33.434538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1940/3841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:33.452700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:33.453325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:33.460300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.460783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.461222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.461947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.462402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.462831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.601963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.611128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-31b42f6c-eb03-4ea8-a194-ede0aa28170d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162266 Sep 06 12:15:33.611726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1902/3842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:33.742271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:33.742939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:33.749343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.749883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.750319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.751027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:33.751484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:33.751910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:33.897255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.906666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.908125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:33.909316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f72c6ba-4f74-4858-95f4-9f684d341264 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.172030 Sep 06 12:15:33.909914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1941/3843] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:34.253926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:34.254558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:34.262196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.262689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.263130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.263850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.264344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.264771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.387801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:34.388428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:34.395098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.395589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.396027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.397670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.398133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.398568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.402820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:34.405108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:34.412731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b74dcb6b-85e7-461f-80cd-8f239593d75c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162596 Sep 06 12:15:34.413319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1903/3844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:34.520043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:34.520662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:34.527896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.528377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.528916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.529622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.530120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.530548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.550580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:34.565177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8acb3966-ab52-4ffe-b148-99487f7f3c6f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.181770 Sep 06 12:15:34.565804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1942/3845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:34 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:34.637031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:34.637031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:34.643226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.643719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.644156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.644868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.645321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.645790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.664508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:34.683433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:34.692017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e6ce26a9-8b2a-4c70-9543-e4aecc56a8a5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.237750 Sep 06 12:15:34.692607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1904/3846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:34.786184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:34.794895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-55446315-1057-4c11-95bc-37b81bd8c415 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162312 Sep 06 12:15:34.795501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1943/3847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:34.935385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:34.936001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:34.942174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.942659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.943178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:34.944524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:34.945000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:34.945435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.086191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:35.095268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:35.096733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:35.098111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-874fd73e-21be-4a8a-ac50-66129e4ca6e9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166663 Sep 06 12:15:35.098685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1905/3848] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:35.436516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:35.437168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:35.443830 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.444315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.444822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.445558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.446034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.446474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.592023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:35.592697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:35.593199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:35.604381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.605188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.605944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.607116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.607544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-da99b4e5-91d5-46c6-9825-7ee0f306aec7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.174175 Sep 06 12:15:35.607899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.608631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.622545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1944/3849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:35.716374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:35.716988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:35.723461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.723953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.725130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.726011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.726465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.726887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.766168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:35.776868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4eb8c4ee-3841-4bb9-86d8-ca9cdec65d7d tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.190234 Sep 06 12:15:35.777796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1906/3850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:35 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:35.823038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:35.823814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:35.832446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.832955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.833399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.835187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:35.835537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:35.836080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:35.880977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:35.896487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-04f8eafb-b6cd-4d36-900b-5a02f1338a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183480 Sep 06 12:15:35.897555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1945/3851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:35.994559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:36.003784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1b7f3d46-18ce-4562-99bb-1e34ac777f20 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.187166 Sep 06 12:15:36.004384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1907/3852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:36.125689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:36.126283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:36.133734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.134223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.134650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.135354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.135800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.136227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.279814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:36.290006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:36.291472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:36.292677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fa1e4972-15cc-4e1c-9e79-1032d29bdeb9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171061 Sep 06 12:15:36.293248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1946/3853] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:36.642522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:36.643925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:36.654709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.655593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.656105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.656835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.657391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.658118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.802791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:36.806837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:36.807982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:36.817122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bfc021ac-b871-4e6b-858c-c544c66cf92b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.180060 Sep 06 12:15:36.818677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1908/3854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:36.819415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.820200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.820971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.822253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.823093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.823892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.922513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:36.923777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:36.931987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.932581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.933218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.934058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:36.934679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:36.935182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:36.988122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:37.003656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9f5030ac-5775-4991-94f7-5650ee30a7d7 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.202033 Sep 06 12:15:37.004312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1947/3855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:36 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:37.032605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:37.033481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:37.043093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:37.043908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:37.044844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:37.046102 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:37.046869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:37.047574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:37.110231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:37.120729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a4741202-a004-4efe-90f0-160e72919eb4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.202514 Sep 06 12:15:37.121342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1909/3856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:37.236771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:37.246721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e46e143-29bc-4bac-9dec-69488cd7fc1f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.217904 Sep 06 12:15:37.248263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1948/3857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:37.318826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:37.319446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:37.326379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:37.326994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:37.327543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:37.328346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:37.328942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:37.329464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:37.510269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:37.522941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:37.524788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:37.526072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ce40eb4e-c86a-47a8-a45e-6ac450187db7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.211230 Sep 06 12:15:37.526998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1910/3858] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:37.848511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:37.849115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:37.857194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:37.857598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:37.858059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:37.858776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:37.859232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:37.859688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.029120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:38.029858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:38.036827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.037435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.037967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.041503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.041784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.041784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.041784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.053801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-86326fda-05f0-48df-aa31-25738394a965 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.209076 Sep 06 12:15:38.055103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1949/3859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:38.151792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:38.151792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:38.156419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.157006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.157516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.158302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.158763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.159192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.207165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.216427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52505a3f-fb80-4a17-aa8b-1160161374f8 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.191531 Sep 06 12:15:38.217022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1911/3860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:38 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:38.270491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:38.271767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:38.284617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.285317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.286142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.287330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.288170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.288754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.313449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.323803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6eed6ad9-3122-4b3c-bfd6-b3997a01cbbb tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.179448 Sep 06 12:15:38.324307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1950/3861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:38.462477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.475447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d5a6401-f86e-4cb2-be1d-fa6fb62d5969 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.208160 Sep 06 12:15:38.476109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1912/3862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:38.558993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:38.559523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:38.565982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.566475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.566911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.567649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:38.569516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:38.570013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:38.722875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.732865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.734548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:38.735822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-11381ced-0b86-4ab1-b722-dcf90d0499f1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.180863 Sep 06 12:15:38.736505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1951/3863] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:15:39.080627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:39.081415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:39.088732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.089230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.089704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.090439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.090903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.091373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.246178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:39.247372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:39.248997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.258320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.258827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.259287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.260014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.260479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.260913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.265106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-62d710f3-69d3-4a01-aedf-6114d0be2553 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.188359 Sep 06 12:15:39.266158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1913/3864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:39.347980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:39.348607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:39.355823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.356321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.356763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.357477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.357976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.358406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.419910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.430005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eb7d45b4-076c-4c44-a457-301df7355e01 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.192211 Sep 06 12:15:39.430664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1952/3865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:39 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:39.514449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:39.515580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:39.527079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.528103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.528989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.530533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.531546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.532441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.534501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.550369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a8d821c2-2ddc-42c4-b582-a2f0a0231816 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.205836 Sep 06 12:15:39.551332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1914/3866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:39.700073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.708910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aba8942d-908c-4985-9537-be3a76107827 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.199395 Sep 06 12:15:39.709494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1953/3867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:39.763161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:39.763782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:39.770146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.770631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.771201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.772106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:39.772496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:39.772947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:39.916605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.925578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.927044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:39.928475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e323526-3f92-403e-bba8-72d5ff2b40c1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169366 Sep 06 12:15:39.929092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1915/3868] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:40.301953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:40.303327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:40.310413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.310907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.311349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.312077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.312527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.312955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.456687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:40.457499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:40.457746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:40.469312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.470149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.470865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.471986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.472085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f0065e18-88c5-4f7d-8da0-5db3cf168257 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.173712 Sep 06 12:15:40.472756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.473190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1954/3869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:40.473325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.589399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:40.590071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:40.596382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.596880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.597516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.598290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.598759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.599821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.628215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:40.637269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bed952e3-95f9-41b3-a469-5d0c5a4476d9 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.186189 Sep 06 12:15:40.638034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1916/3870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:40 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:40.735689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:40.736793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:40.745483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.746020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.746460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.747194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.747643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.748079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.751550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:40.769296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7518a44f-10c9-46e4-b34a-09bfdf0b14b9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183499 Sep 06 12:15:40.770381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1955/3871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:40.908709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:40.918683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-506efe5a-7b65-49a5-9101-2fcf7a673889 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.189313 Sep 06 12:15:40.919430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1917/3872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:40.954663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:40.955285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:40.962026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.962519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.962953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:40.963652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:40.964126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:40.964541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.123601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:41.134613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:41.136121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:41.137395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-75e39aa5-0c86-4699-bf90-147968885f82 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.186709 Sep 06 12:15:41.138025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1956/3873] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:40 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:41.496768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:41.497464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:41.504462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.504959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.505448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.506220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.506681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.507112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.652343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:41.668673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:41.669358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:41.669455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dd667b27-4bdd-4314-ba39-772919c733f9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.176053 Sep 06 12:15:41.670525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1918/3874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:41.676501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.676993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.677994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.678901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.679368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.679806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.796316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:41.796953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:41.803900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.804356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.804794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.805524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.806183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.806461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.847904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:41.858343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6a17e99e-2928-4484-a929-e30e0af9d18a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.193264 Sep 06 12:15:41.859154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1957/3875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:41 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:41.949026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:41.949874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:41.957405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.957928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.958364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.959753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:41.960441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:41.961033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:41.965085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:41.973803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f8e4770-4778-4d89-af3a-71266ab41410 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.181593 Sep 06 12:15:41.974446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1919/3876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:42.118019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:42.130090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-256bb331-6933-4cb6-a6dc-bc08c66f214e tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.186619 Sep 06 12:15:42.131295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1958/3877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:42.167694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:42.168351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:42.175065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:42.175560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:42.175999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:42.176711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:42.177846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:42.179024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:42.199199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:42.335220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:42.348606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:42.350738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:42.351977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-808d3026-0bc2-4e89-bacd-1b6a3448f81b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.188630 Sep 06 12:15:42.352550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1920/3878] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:42.712516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:42.713142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:42.720762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:42.721267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:42.721742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:42.722465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:42.722922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:42.723353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:42.884852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:42.885138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:42.886448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:42.894486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ebfb22ea-9f63-4813-80c2-44ea21f2265b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.185963 Sep 06 12:15:42.895067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1959/3879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:42.899362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:42.900278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:42.901060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:42.902629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:42.903407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:42.904211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:42.999152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:42.999848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:43.007050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.007659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.008194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.008991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.009533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.010082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.014895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:43.063940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:43.079088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8d611d70-f1eb-49ef-8d3b-c3058dbc9072 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.200329 Sep 06 12:15:43.079740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1921/3880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:42 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:43.155779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:43.156406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:43.163688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.164188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.164658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:43.164797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.165417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.165903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.166332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.173293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-664c7872-4a84-4e13-ae45-12eb96b95ade tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.178541 Sep 06 12:15:43.173911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1960/3881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:43.306463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:43.316924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f26a1153-67bc-446a-b08a-51ee0b5132e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.166104 Sep 06 12:15:43.317514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1922/3882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:43.378433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:43.379059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:43.386079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.386559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.387007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.387747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.388206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.388637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.536285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:43.545303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:43.546782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:43.548000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-72645a7a-4357-4aeb-b38a-e69329790e3f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.173599 Sep 06 12:15:43.548559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1961/3883] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:43.919241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:43.919858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:43.926613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.927101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.928284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:43.929086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:43.929545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:43.930013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.069886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.078378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-84257c18-8e22-460c-b5bb-b4e660d22095 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163057 Sep 06 12:15:44.078968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1923/3884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:44.103940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:44.104553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:44.110921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.111403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.111836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.112512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.112965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.113380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.196329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:44.196945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:44.202877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.203359 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.203790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.204475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.204927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.205349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.251701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.261128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9dbd77b-90a9-46b7-965b-45afa417e4eb tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161112 Sep 06 12:15:44.262161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1962/3885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:44 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:44.342646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:44.343259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:44.348832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.349797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.350587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.351035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.351738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.352193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.352618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.358534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-54549b89-d1ac-48a8-844a-7e26d6bae7d6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.166066 Sep 06 12:15:44.359584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1924/3886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:44.488844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.498443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f5df871-cb3b-423f-90e6-f150e43337cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159594 Sep 06 12:15:44.499025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1963/3887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:44.579272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:44.579926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:44.586460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.586944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.587381 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.588067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:44.588522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:44.588945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:44.719598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.729196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.730650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:44.731806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-34febd9c-3602-485f-8013-0d9bd195bc8b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156546 Sep 06 12:15:44.732362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1925/3888] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:45.101733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:45.102597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:45.109370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.110004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.110308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.111042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.111498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.111916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.254914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.264131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c964ce2-e2d7-404c-afad-783096860bde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166686 Sep 06 12:15:45.264715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1964/3889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:45 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:45.284278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:45.284964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:45.291983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.292469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.292957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.293599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.294091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.294521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.383589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:45.384215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:45.390259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.390744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.391183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.391882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.392336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.392780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.479089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.493895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9593da24-8eb1-4cca-ba50-231e608c1dbd tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.212677 Sep 06 12:15:45.495394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1926/3890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:45 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:45.522023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:45.522777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:45.529043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.529522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.529995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.530691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.531140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.531562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.535004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.544446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e05d915e-4525-48a7-a4d7-5d113a6be845 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165409 Sep 06 12:15:45.545036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1965/3891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:45.670119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.679418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d88a72a2-84be-414a-934b-7b18b378c046 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161335 Sep 06 12:15:45.680013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1927/3892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:45.757185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:45.757823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:45.763708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.764181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.764608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.765288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:45.765764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:45.766189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:45.902037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.910568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.912649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:45.913839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6e01322a-17fa-4e13-ac8e-b75f3464c203 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160573 Sep 06 12:15:45.914403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1966/3893] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:45 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:46.289868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:46.290523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:46.297171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.297683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.298125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.298825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.299284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.299761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.449300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:46.457568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0552c7f3-fe29-4cd7-aca4-d0b172d78171 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.173038 Sep 06 12:15:46.458172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1928/3894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:46.528498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:46.529037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:46.537938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.538480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.538908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.539602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.540050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.540470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.569564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:46.570328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:46.576476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.577069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.577570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.578384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.579031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.579716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.685186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:46.694573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-feac237d-7e74-4cc4-8c3e-63a47b18a2b5 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.170178 Sep 06 12:15:46.695172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1967/3895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:46 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:46.704912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:46.705614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:46.712438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.712936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.713376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.714105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.714566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.715117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.724835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:46.733054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e0dda40-d1ef-4927-9b43-576921f76aa0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168118 Sep 06 12:15:46.733742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1929/3896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:46.846455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:46.855351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34bac8e4-f5c3-4dc2-992a-86f319c15fe9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.154448 Sep 06 12:15:46.855924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1968/3897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:46.940125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:46.940736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:46.947655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.948139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.948583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:46.949267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:46.949798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:46.950191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.082560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:47.091195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:47.092636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:47.093875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-708c86cf-101e-4045-8570-58817ab55973 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157727 Sep 06 12:15:47.094432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1930/3898] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:47.481630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:47.482299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:47.488396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.488888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.489326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.490105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.490666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.491103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.633309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:47.641614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7dcbd2e5-14b3-4396-b0de-0f6ca540c608 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163827 Sep 06 12:15:47.642238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1969/3899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:47.718314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:47.718885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:47.726274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.726818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.727296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.728041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.728545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.729009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.756266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:47.756876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:47.762849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.763330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.763765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.764445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.764916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.765318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.871473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:47.880013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6d729cb-5c01-4586-8bbf-0188e96c148c tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.165585 Sep 06 12:15:47.880691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1931/3900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:47 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:47.885223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:47.885856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:47.891743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.892222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.892819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.893505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:47.894159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:47.894583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:47.904235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:47.913334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e9f71df5-aa59-4c44-a863-a2a3875a7bd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160989 Sep 06 12:15:47.914264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1970/3901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:48.028706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:48.037662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2e02d6c4-ea47-41fb-a136-0a24d80489d8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155990 Sep 06 12:15:48.038245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1932/3902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:47 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:48.122106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:48.122891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:48.131314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.131943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.132595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.133570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.134284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.134814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.279796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:48.293152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:48.294715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:48.295926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-afa8d9e4-9e9f-4a88-a9dc-0b5b47bdd36a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.177801 Sep 06 12:15:48.296503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1971/3903] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:48.666356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:48.666968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:48.673880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.674384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.674826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.675532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.675989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.676416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.809525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:48.818238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ef226d5d-8abc-4be5-9a47-6d90efab90a0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155514 Sep 06 12:15:48.818949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1933/3904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:48.904086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:48.904700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:48.911082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.911823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.912266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.912949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.913406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.913865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.937924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:48.938634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:48.945379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.946102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.946644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:48.947666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:48.948136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:48.948613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.048326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.058227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9a1ba52f-b667-42f4-acac-db2cb08d0f0a tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.158140 Sep 06 12:15:49.073865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1972/3905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:48 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:49.073865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:49.073865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:49.073865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:49.074302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:49.074302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.074302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:49.074302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:49.074680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.085607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.093906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-03615a95-4c29-48a5-85a9-1e1a119eb8e3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159842 Sep 06 12:15:49.094489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1934/3906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:48 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:49.210175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.218450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bd416c63-4c58-49c0-ac52-f433653c574b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158488 Sep 06 12:15:49.219023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1973/3907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:49.322004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:49.322534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:49.328419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:49.328889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:49.329318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.330117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:49.330473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:49.330891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.460138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.468798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.470282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.471457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f6874bd-6332-48b6-8dac-5edc1c71c4c5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.153702 Sep 06 12:15:49.472019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1935/3908] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:49.841525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:49.842080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:49.848303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:49.848780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:49.849210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.850525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:49.850980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:49.851396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:49.985001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:49.999287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-571dea81-7f10-4760-9e64-0fa44e9d46a5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161578 Sep 06 12:15:49.999879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1974/3909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:50.084486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:50.085376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:50.091947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.092416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.092892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.093669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.094136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.094564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.120304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:50.121434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:50.127850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.128338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.132021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.132021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.132021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.132021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.239354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:50.257671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cbdb6d0f-8a84-4040-9fb5-bb4e827b71f3 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.177567 Sep 06 12:15:50.258528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1936/3910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:50 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:50.263482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:50.263892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:50.269878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.270373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.271390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.272351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.272903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.273256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.278818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:50.291851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:50.300249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eded7e38-8188-48ba-9808-1ad7f78f3303 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183837 Sep 06 12:15:50.300832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1975/3911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:50.406408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:50.414760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-644b885b-f01d-4351-bdfc-1f3456368f01 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155497 Sep 06 12:15:50.415354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1937/3912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:50.498253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:50.498875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:50.504768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.505242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.506326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.507012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:50.507461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:50.507879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:50.640813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:50.643101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:50.651005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:50.652757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:50.653971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-df6ca4ae-ba28-4b3c-82cf-7bc09c935f36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159882 Sep 06 12:15:50.654536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1976/3913] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:51.023279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:51.023887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:51.030196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.030679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.031111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.031800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.032249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.032667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.172335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.181879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-88ad4f42-c1da-4eba-8977-2556758fca4a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162367 Sep 06 12:15:51.182482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1938/3914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:51.285940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:51.286536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:51.293390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.293911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.294349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.295054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.295511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.296090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.324508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:51.325346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:51.331213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.331702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.332142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.332875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.333335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.333789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.434657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.444232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ef88c3d-fb9b-4572-ab06-6b5f6950225f tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161729 Sep 06 12:15:51.445013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1977/3915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:51 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:51.449484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:51.450173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:51.456282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.456775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.457214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.457947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.458408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.458885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.470149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.479554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3689ccc2-af39-409b-8f4f-ec251c75ebf2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.158855 Sep 06 12:15:51.480179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1939/3916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:51.613207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.623364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0c7c817-28c8-418c-9194-f98af13aa80a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.177480 Sep 06 12:15:51.624077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1978/3917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:51.680517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:51.681128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:51.687283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.687768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.688207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.688902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:51.689358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:51.689823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:51.827462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.836352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.837853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:51.839026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-373b4d3f-314e-4364-b073-5c99f6fbbdbc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163139 Sep 06 12:15:51.839592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1940/3918] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:51 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:52.206900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:52.207512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:52.210213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:52.215955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.216449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.216887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.217592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.218081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.218561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.357592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:52.367544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b69ef800-678a-4a86-9c24-dea7f70bdd30 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164469 Sep 06 12:15:52.368155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1979/3919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:52.468761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:52.469424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:52.476400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.476855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.477296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.478016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.478476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.478898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.503697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:52.504347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:52.510947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.511440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.511881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.512576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.513034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.513463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.617188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:52.625847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-255dec41-0c59-408a-a77b-169cb789c076 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160991 Sep 06 12:15:52.626460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1941/3920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:52 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:52.649333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:52.650198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:52.658352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.658991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.659476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:52.659626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.660491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.661095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.661693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.668317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4da1c156-4b1d-4284-89b4-796a7545e17b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168312 Sep 06 12:15:52.668901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1980/3921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:52.804762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:52.816154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ac9412bd-e9f3-47e2-ad65-848553e823b2 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173019 Sep 06 12:15:52.816741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1942/3922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:52.866270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:52.867316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:52.873914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.874409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.874847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:52.875556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:52.876012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:52.876434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.037931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:53.047190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:53.048685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:53.049910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-26303e17-a40e-4374-a95d-cedf28a84d18 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.188835 Sep 06 12:15:53.050481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1981/3923] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:53.391116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:53.391651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:53.393512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:53.399589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.400065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.400496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.401180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.401915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.402341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.551014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:53.561705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2f5e410b-d52f-4364-b16d-8e340935b844 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.174291 Sep 06 12:15:53.562466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1943/3924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:53.652224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:53.652780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:53.659972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.660594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.661125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.661888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.662538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.662968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.694591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:53.695367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:53.702880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.703378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.703816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.704528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.704984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.705414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.813691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:53.823026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b0f0e1a8-eb51-41dc-bfcc-e72b387b390b tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.176540 Sep 06 12:15:53.823929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1982/3925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:53 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:53.847765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:53.848465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:53.854760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.855250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.855399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:53.855683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.856383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:53.856980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:53.857240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:53.863997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7921bbc8-3486-41bc-8d52-9b30334efe56 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175195 Sep 06 12:15:53.864584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1944/3926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:53.996220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:54.004805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90ec3565-a711-42c8-b266-d85cae1cdec0 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165881 Sep 06 12:15:54.005391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1983/3927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:53 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:54.077103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:54.077766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:54.083979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.085079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.085520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.086274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.086739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.087179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.229698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:54.241295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:54.242927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:54.244125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e8f68d5b-ad8b-4b6e-9728-61a7d2c2e402 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171203 Sep 06 12:15:54.244692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1945/3928] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:54.585782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:54.586309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:54.592649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.593141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.593589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.594312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.594767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.595215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.730822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:54.739206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9d994951-786f-426a-beff-01e466600098 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157630 Sep 06 12:15:54.739780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1984/3929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:54.855289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:54.855881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:54.862479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.862962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.863430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.864126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.864580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.865088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.889939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:54.890559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:54.898444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.899144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.899596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:54.900300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:54.900761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:54.901193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.003647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.012201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e2af7824-477c-4ad5-a250-10b44fc475d2 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.160928 Sep 06 12:15:55.012782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1946/3930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:54 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:55.029191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:55.029956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:55.035874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:55.036362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:55.036799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.037567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:55.038070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:55.038501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.046864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.056213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5e63e9ac-b5e2-4a6c-8bef-57f87421ea6b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.170088 Sep 06 12:15:55.056929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1985/3931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:55.167938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.176305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6543069-1a9e-4579-a59e-5950100352b7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.151436 Sep 06 12:15:55.176884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1947/3932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:55.270583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:55.271187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:55.277758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:55.278249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:55.278677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.279365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:55.279812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:55.280226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.413694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.422424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.423888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.425061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab770525-5419-47ca-8a19-c49316beb0dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.158432 Sep 06 12:15:55.425623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1986/3933] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:55.763215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:55.763825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:55.769942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:55.770426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:55.770890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.772149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:55.772601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:55.773024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:55.909866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:55.919337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d216532d-0586-4e7d-b561-21ada2d9ff76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160307 Sep 06 12:15:55.919899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1948/3934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:56.036361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:56.036973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:56.043672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.044147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.044575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.045254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.045727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.046148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.079957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:56.080572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:56.087407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.087899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.088337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.089044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.089505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.089979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.180795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:56.189090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7a205d52-4a3e-4a8b-a611-0632eaed3118 tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.156831 Sep 06 12:15:56.189695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1987/3935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:56 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:56.201539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:56.202893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:56.210709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.211200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.211644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.212344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.213724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.214154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.222720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:56.231147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-415c42b9-ffe0-4b65-a010-4a5e385ffa05 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154839 Sep 06 12:15:56.231759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1949/3936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:56.352733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:56.361146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f1f4c287-2f79-4e1d-94e6-09f9aab7a63b tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.164130 Sep 06 12:15:56.361771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1988/3937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:56.451192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:56.451715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:56.457818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.458310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.458751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.459451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.459911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.460338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.593492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:56.602358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:56.603830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:56.605017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ea3865d7-6c0e-4eb1-8e3b-4f290d0bbdf2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157938 Sep 06 12:15:56.605580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1950/3938] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:56.943204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:56.944033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:56.951300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.951813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.952258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:56.952970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:56.953455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:56.953922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.092863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.102174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-faa1a0f1-bcb5-4353-95a1-b0d8ba82dc3c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162922 Sep 06 12:15:57.102759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1989/3939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:57.214538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:57.215068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] [instance: 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:57.221636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.222155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.222599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.223298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.223758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.224188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.257527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:57.258185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:57.264642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.265134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.265571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.266310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.266765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.267193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.362107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317022dc9f1d46cbbe7190edd7832e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223f7e0f4ea74b398aad606cf1e7c150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.371315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d718033b-820f-454a-bb17-66d55ac532bc tempest-VolumesSnapshotTestJSON-1720789506 tempest-VolumesSnapshotTestJSON-1720789506-project] 10.222.0.18 "GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7" status: 200 len: 1559 microversion: 2.1 time: 0.161918 Sep 06 12:15:57.371914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1951/3940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:57 2022] GET /compute/v2.1/servers/8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:57.384534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:57.385709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:57.391243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.391243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.391243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.391243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.398185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.398185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.411115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.420269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c608ade3-d0de-4b82-b14a-6c8f39c8a289 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168216 Sep 06 12:15:57.421076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1990/3941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:57.533879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.545793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d4692010-f610-4e8b-8cb5-d959318ee4cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165067 Sep 06 12:15:57.546388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1952/3942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:57.632203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:57.632825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:57.641098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.641612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.642082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.642800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:57.643264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:57.643693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:57.778953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.789928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.791634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:57.792838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4ec6e5a5-8a7e-4387-9f95-b116ecce421f tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165017 Sep 06 12:15:57.793430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1991/3943] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:57 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:58.125421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:58.126168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:58.132245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.132738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.133182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.133933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.134398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.135913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.279012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:58.281176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:58.288946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4c1ccb15-85a9-44da-b279-2aeb6afdf16b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.167373 Sep 06 12:15:58.289532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1953/3944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:58.446393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:58.447015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:58.453510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.454031 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.454476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.455165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.455624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.456054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.570425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:58.571044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:58.576950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.577425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.577897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.578591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.579040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.579512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.599120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:58.607528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e20b8367-5f36-4def-b518-1b0ea336c5e8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165413 Sep 06 12:15:58.608082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1992/3945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:58.714972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:58.723277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-075f3507-f625-4566-a236-fd76701b1aa4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157292 Sep 06 12:15:58.723858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1954/3946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:15:58.821085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:58.822444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:58.829595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.830110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.830541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.831234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:58.831680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:58.832098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:58.848566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:15:58.969902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:58.979205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:58.980643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:58.981844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b36ce6f1-f7c4-445c-af7b-f8cdf2546282 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165895 Sep 06 12:15:58.982406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1993/3947] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:15:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:15:59.312558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:59.313171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:59.319920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:59.320402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:59.320839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:59.321525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:59.322025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:59.322453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:59.455145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:59.463919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bd58affa-0d87-4410-a6d2-f6d55c59f13b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155332 Sep 06 12:15:59.464488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1955/3948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:59.631741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:59.632387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:59.638882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:59.639397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:59.639836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:59.640528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:59.640989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:59.641412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:59.747017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:15:59.747687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:15:59.753581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:59.754096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:59.754600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:59.755302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:15:59.755760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:15:59.756895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:15:59.776938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:59.785197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41562240-6262-4423-9ca6-9903d6fb469e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157904 Sep 06 12:15:59.785800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1994/3949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:15:59.884976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:15:59.893373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7568e1b7-22b7-4749-991d-37c1092aca35 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.150259 Sep 06 12:15:59.893983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1956/3950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:15:59 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:00.008696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:00.009314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:00.016039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.016537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.017258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.017721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.018185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.018646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.155228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:00.165064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:00.166703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:00.167916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-312eec75-90c4-4abf-90d0-f9b3e494044e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163978 Sep 06 12:16:00.175686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1995/3951] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:00.487960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:00.488576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:00.491407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:16:00.491532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:16:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 (ip 10.222.0.18) !!! Sep 06 12:16:00.499191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.499678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.500119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.500817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.501283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.501743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.633000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:00.641617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-77caac9e-20e9-414f-8e35-a7a75e7c709c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157502 Sep 06 12:16:00.642730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1957/3952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:00.809117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:00.809714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:00.816154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.816641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.817084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.817804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.818268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.818700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.918371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:00.918998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:00.924951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.925437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.925915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.926613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:00.927070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:00.927499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:00.948918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:00.957473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-385bc8ba-f9ae-4309-9c97-93d58ef8e0af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152317 Sep 06 12:16:00.958087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1996/3953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:01.064782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:01.076433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c2d85b80-bd11-423e-b36f-0faded9ccbb8 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161871 Sep 06 12:16:01.077072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1958/3954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:01.196218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:01.196837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:01.202897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:01.203391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:01.203827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:01.204523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:01.204980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:01.205406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:01.344464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:01.353960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:01.355429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:01.356674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bac2d7d8-5fc9-4b9e-8e4f-011a24e551ef tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164568 Sep 06 12:16:01.357244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1997/3955] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:01.665850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:01.666475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:01.672986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:01.673468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:01.673940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:01.674660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:01.675121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:01.675549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:01.804282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:01.812483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5d5d6ece-ec5e-4523-a833-eb0275d64ba3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.150842 Sep 06 12:16:01.813057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1959/3956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:01.982145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:01.982775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:01.989165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:01.989666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:01.990120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:01.991466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:01.991926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:01.992401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.104305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:02.105513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:02.111665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:02.112270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:02.112811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.113839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:02.114407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:02.115275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.126346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:02.134628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e93556d-69f4-470e-8b18-a96d715cd113 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.156672 Sep 06 12:16:02.135207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1998/3957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:01 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:02.255353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:02.265633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66bb2baa-9af6-4aa1-b35a-76af836ed8a1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167259 Sep 06 12:16:02.266286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1960/3958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:02.382924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:02.383751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:02.390142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:02.390632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:02.391066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.391800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:02.392252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:02.392677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.531826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:02.541523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:02.543015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:02.544209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9606cd02-5820-4dfb-8268-10a1a62f2697 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166932 Sep 06 12:16:02.544795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 1999/3959] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:02.836688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:02.837277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:02.843796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:02.844269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:02.844695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.845372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:02.845856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:02.846284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:02.976815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:02.985719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-467322e8-1e39-4386-8dad-0b935062d278 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153542 Sep 06 12:16:02.986292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1961/3960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:03.158187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:03.158852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:03.165894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:03.166373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:03.166805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:03.167483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:03.167959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:03.168378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:03.291059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:03.291677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:03.297987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:03.298484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:03.299040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:03.299594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:03.300137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:03.300605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:03.301040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:03.308808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5152ffb8-cad3-40bc-8edc-158c96698d19 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.154541 Sep 06 12:16:03.309682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2000/3961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:03.435158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:03.444040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c3f555fb-4d28-4703-ad71-282a33e23929 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157015 Sep 06 12:16:03.444624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1962/3962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:03.570629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:03.571231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:03.577052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:03.577531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:03.578000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:03.578678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:03.579127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:03.579546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:03.706654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:03.715739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:03.717212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:03.718405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-42ec301e-253f-4bfb-9d37-319126aea377 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.152301 Sep 06 12:16:03.718977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2001/3963] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:03 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:04.009358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:04.009992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:04.016394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.016872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.017305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.018012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.018498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.018913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.154004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:04.163573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b45887a0-9002-43a1-8c0e-eff41ac43136 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157716 Sep 06 12:16:04.164152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1963/3964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:04.332129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:04.332664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:04.340063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.340552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.340998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.341723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.342189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.342620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.469426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:04.470120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:04.476678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.477172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.477602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.478337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.478789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.479206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.484139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:04.492962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ac6ed4dd-95a0-4cf7-8a99-c5a5a7218ff9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164702 Sep 06 12:16:04.493712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2002/3965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:04.634799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:04.643395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-afca20dc-1dc2-4e4d-a7a0-c3174cdcbde4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.177736 Sep 06 12:16:04.643985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1964/3966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:04.743880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:04.744601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:04.751886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.752388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.752833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.753555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:04.754052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:04.754484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:04.897574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:04.907072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:04.908524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:04.909729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca4aed68-aa35-44d8-89ce-c47cf2813d11 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169932 Sep 06 12:16:04.910300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2003/3967] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:05.188511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:05.189119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:05.197001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.197484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.197952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.198642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.199100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.199569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.341541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:05.350492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7fd5ff14-e083-42a9-9923-94980d685612 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165760 Sep 06 12:16:05.351078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1965/3968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:05.516643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:05.517171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:05.525151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.525638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.526111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.527054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.527507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.527932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.663585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:05.668845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:05.669468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:05.672050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-792d1bea-586d-4a4e-9e47-1dc7a4689049 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.159358 Sep 06 12:16:05.672625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2004/3969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:05.675354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.675841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.676281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.676972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.677464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.678629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.807282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:05.815354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6a2a349e-9182-432c-85cd-14a34963e433 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.150466 Sep 06 12:16:05.815929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1966/3970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:05.936145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:05.936754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:05.942772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.943345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.943782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:05.944468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:05.944922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:05.945346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.077039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:06.086456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:06.087904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:06.089084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-da3e6a9a-ed39-4998-b426-2b85293368d6 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.156917 Sep 06 12:16:06.089669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2005/3971] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:06.374699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:06.375313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:06.382550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:06.383044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:06.383486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.384194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:06.384657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:06.385095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.526121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:06.534823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-98231a9a-411c-4a28-887e-f110a97e0e73 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163960 Sep 06 12:16:06.535403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1967/3972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:06.695962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:06.696580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:06.703151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:06.703642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:06.704081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.704786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:06.705241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:06.705697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.839279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:06.839890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:06.843380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:06.846210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:06.846702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:06.847128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.847817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:06.848267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:06.848686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:06.853570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a499646b-db06-4a21-ad26-ae7a7c4cd7e2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.161442 Sep 06 12:16:06.854311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2006/3973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:06.982384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:06.990811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-683741dd-735e-417f-bac6-ab2287e685c7 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155376 Sep 06 12:16:06.991402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1968/3974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:06 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:07.117565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:07.118123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:07.124223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.124715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.125158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.125888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.126346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.126771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.262203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:07.271085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:07.272923 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:07.274132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-325688e3-35b6-4b39-a51f-987751f7c82b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161361 Sep 06 12:16:07.274706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2007/3975] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:07.560281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:07.560903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:07.566954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.567484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.567888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.569309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.569920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.570382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.712831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:07.721090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5d4bcd0d-b9b1-4b86-a6a3-8a74f5b72c44 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165565 Sep 06 12:16:07.721684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1969/3976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:07.877360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:07.878004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:07.884756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.885238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.885702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:07.886402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:07.886861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:07.887288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.019231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.022019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:08.022635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:08.028413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f9036949-a131-4fc2-a7cb-8e5d15a130c3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155116 Sep 06 12:16:08.028918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.029029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2008/3977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:07 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:08.029397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.029867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.030554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.031002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.031421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.048908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:08.167342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.175495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-69e78fe1-da7a-465c-b8f5-e88c04069ee3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157737 Sep 06 12:16:08.176075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1970/3978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:08.300459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:08.301074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:08.307107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.307594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.308034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.308726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.309186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.309669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.452428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.462244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.463977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.465058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-670b010c-bd5e-4b9b-b6ce-d567b9051578 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168537 Sep 06 12:16:08.465623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2009/3979] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:08.745137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:08.745853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:08.753226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.753629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.754107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.754823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:08.755283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:08.756475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:08.890695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:08.899273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-533f8a91-ce0e-4f87-9df8-fc096bb1fae5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158016 Sep 06 12:16:08.899853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1971/3980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:09.052955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:09.053683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:09.060263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.060745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.061175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.061941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.062394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.062816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.067970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:09.199981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:09.200996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:09.204094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:09.207355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.207956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.208397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.209144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.209694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.210135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.213667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9d1cd2ec-4cd0-43dd-9ae7-88293f914936 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165044 Sep 06 12:16:09.214251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2010/3981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:09 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:09.341391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:09.350981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0af0fd75-b734-4564-b8b4-1452bea1e1cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155056 Sep 06 12:16:09.351553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1972/3982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:09.491384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:09.491994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:09.498639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.499130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.499542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.500789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.500789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.501081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.640329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:09.649984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:09.651531 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:09.652978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09531912-0936-4683-9487-852904b99071 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166035 Sep 06 12:16:09.653549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2011/3983] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:09 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:09.923831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:09.924455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:09.931095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.931590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.932064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:09.932779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:09.933243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:09.933707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.086505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.094969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-95c61a58-3ada-4d7e-9713-5ab033155a89 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.175054 Sep 06 12:16:10.095591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1973/3984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:10.237747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:10.238292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:10.245422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.245956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.246407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.247110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.247569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.247999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.376965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:10.377588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:10.385476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.386575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.387031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.387788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.388198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.388627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.390469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.399825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-625e2999-d5a1-4a7a-ab68-0ea0bf1e75c6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.165967 Sep 06 12:16:10.400428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2012/3985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:10 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:10.528135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.536771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91487145-239a-4a0b-9c37-94f3f631a168 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163886 Sep 06 12:16:10.537449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1974/3986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:10.680816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:10.681454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:10.687363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.687838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.688266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.688939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:10.689391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:10.689838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:10.816823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.826084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.827535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:10.828701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c9a46fb5-0245-46b5-b821-1b7e409732b1 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.152810 Sep 06 12:16:10.829271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2013/3987] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:11.119470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:11.120092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:11.126125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.126608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.127048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.127746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.128203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.128632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.263361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:11.272480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f894dd06-1203-4bc2-9514-a2c861ebcc4f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156521 Sep 06 12:16:11.273057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1975/3988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:11.424085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:11.424699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:11.431950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.432435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.432873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.433568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.434044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.434466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.561259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:11.562092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:11.569330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.569890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.570337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.571060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.571518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.572133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.585463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:11.594347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a21a25e2-7f48-46cf-95ea-f8760025c1b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.173838 Sep 06 12:16:11.595012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2014/3989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:11 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:11.721270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:11.729767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dcc81b7e-5f80-4959-a5bd-7ad990f70157 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.172413 Sep 06 12:16:11.730347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1976/3990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:11 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:11.855178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:11.855797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:11.861967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.862459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.862896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:11.863597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:11.864056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:11.864481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.000694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.010589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.012050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.013289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-23f6c067-b480-414f-a6c6-5ae08caa342c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162097 Sep 06 12:16:12.013852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2015/3991] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:12.298235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:12.298857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:12.306272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:12.306756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:12.307192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.307924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:12.308373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:12.308791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.456565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.465076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ff2d662e-b13e-4890-8bd3-019d9ca9d5ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170751 Sep 06 12:16:12.465694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1977/3992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:12.617368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:12.617911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:12.624540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:12.625059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:12.625502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.626239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:12.626726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:12.627432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.753927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:12.754667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:12.761538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:12.762154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:12.762696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.763385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:12.763844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:12.764274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:12.770802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.780415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e929059-1448-4bdc-8465-e4651035fbed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167159 Sep 06 12:16:12.781015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2016/3993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:12 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:12.908908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:12.918055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7461a94b-1390-43be-a57d-0537204ff172 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.168146 Sep 06 12:16:12.918653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1978/3994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:13.039480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:13.040095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:13.046730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.048040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.048514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.049251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.049800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.050312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.195370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:13.204706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:13.206203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:13.207391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2f4a3929-bac4-4c39-9d5a-16e81f68f96d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171976 Sep 06 12:16:13.207963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2017/3995] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:13.489104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:13.489790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:13.496660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.497154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.497593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.498326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.498782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.499216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.635430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:13.644278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-afb7fe81-5acf-4b60-881e-ddc0d6d02002 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159104 Sep 06 12:16:13.644870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1979/3996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:13.808944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:13.810116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:13.821535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.822468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.823271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.824539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.825388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.826299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.941177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:13.941840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:13.948578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.949070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.949511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:13.950649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:13.950741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:13.951145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.015503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.024455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9bc55428-5e84-4529-b2c9-d2c3f1e364f0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.223415 Sep 06 12:16:14.025040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2018/3997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:13 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:14.103683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.112374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6212d202-a8e3-4eb8-a0f6-8b79369f46bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.175142 Sep 06 12:16:14.112992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1980/3998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:14.239608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:14.240620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:14.247143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:14.247752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:14.248299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.249476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:14.250237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:14.250779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.409528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.418920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.420447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.421697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-04cd31f8-cdf2-4dcf-ab2b-bdc5400e6959 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.188919 Sep 06 12:16:14.422286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2019/3999] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:14 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:14.668016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:14.668639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:14.675092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:14.675581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:14.676020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.676720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:14.677178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:14.677628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:14.827472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:14.836355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dcc4db1f-5081-4ad4-b173-e6debfcfced9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.172126 Sep 06 12:16:14.836944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1981/4000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:15.056592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:15.057129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:15.064725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.065318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.065788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.066498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.066958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.067389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.136725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:15.137262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:15.144328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.144328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.144328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.145021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.145469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.146261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.222155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:15.234224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5581db51-64d9-4302-b244-f833c9bfc30d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.181381 Sep 06 12:16:15.235279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2020/4001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:15 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:15.293212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:15.302072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5606c6d8-c8b0-43eb-b512-3b3f8311b870 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169226 Sep 06 12:16:15.302803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1982/4002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:15.448506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:15.449119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:15.455262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.455750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.456198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.456898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.457352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.457811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.602049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:15.611158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:15.612616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:15.613829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4dd652e1-2c1b-44ee-be5e-61e3f0daf3cc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.169373 Sep 06 12:16:15.614398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2021/4003] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:15 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:15.860419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:15.861287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:15.869312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.869843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.870282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:15.871145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:15.871605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:15.872122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.017349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:16.026490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4e9c9ad1-95ca-469b-8d55-8606da61cd56 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170174 Sep 06 12:16:16.027331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1983/4004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:16.264311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:16.264927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:16.272073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.272560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.273157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.273883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.274336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.274787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.325831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:16.326451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:16.333231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.333742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.334687 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.335878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.336330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.336900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.416840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:16.425590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d84dcf94-c49a-4d52-9ca5-3ebd09b18a47 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168237 Sep 06 12:16:16.426767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2022/4005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:16 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:16.482789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:16.491387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9bf188f4-110f-4960-a44b-9bd7805470bd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169640 Sep 06 12:16:16.491962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1984/4006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:16 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:16.642748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:16.643368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:16.650290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.650784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.651218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.652170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:16.652630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:16.653057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:16.788175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:16.796973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:16.798473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:16.799651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f3f445d3-6586-4663-a57f-bdbfb91df04a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160902 Sep 06 12:16:16.800223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2023/4007] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:16 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:17.051203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:17.051741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:17.058223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.058709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.059150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.059842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.060302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.060729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.190706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.199959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-16e63659-0176-4ce9-9213-a6778fe3e243 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152889 Sep 06 12:16:17.200533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1985/4008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:17.449136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:17.449780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:17.456278 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.456802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.457247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.457973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.458436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.458868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.514904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:17.515536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:17.523134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.523619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.524054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.524750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.525202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.525630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.591995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.600876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-03e19f6e-da22-42a5-a87e-afccaed1133b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.155448 Sep 06 12:16:17.601473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2024/4009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:17 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:17.660434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.669170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-576adc19-1a88-4a30-bf2e-3882218f82aa tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.158258 Sep 06 12:16:17.669757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1986/4010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:17.825428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:17.825986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:17.832151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.832632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.833060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.833811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:17.834356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:17.835049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:17.964684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.973941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.975747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:17.977000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-75686894-a839-444e-a7d6-b2dfd5ff4232 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.155600 Sep 06 12:16:17.977786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2025/4011] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:17 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:18.223424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:18.224032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:18.230497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.230982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.231417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.232100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.232545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.232963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.235522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:18.368656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:18.376903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ad35ba0-056d-426d-83e4-7511d9ddf78a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157374 Sep 06 12:16:18.377477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1987/4012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:18.624874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:18.625403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:18.632513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.633004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.633447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.634182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.634640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.635073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.692542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:18.693943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:18.700493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.700980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.701419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.702153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:18.702610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:18.703066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:18.774828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:18.777421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:18.785361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a972c5da-afd3-40b9-a874-628f4363a145 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164254 Sep 06 12:16:18.785998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2026/4013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:18 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:18.842648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:18.851317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6a749c15-f70c-4957-b272-10c838a0c54c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162719 Sep 06 12:16:18.851888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1988/4014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:18 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:19.003410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:19.004055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:19.010158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.010649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.011116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.011960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.012283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.012715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.144981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:19.154052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:19.155493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:19.157157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-48296091-9db7-48ac-acbc-620686d89ea9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157550 Sep 06 12:16:19.157292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2027/4015] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:18 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:19.401057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:19.402035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:19.408331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.408826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.409274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.410057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.410528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.410961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.552440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:19.560876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-901c634b-d417-40d9-892a-024ba252d8b5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164250 Sep 06 12:16:19.561464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1989/4016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:19.809267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:19.809922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:19.816610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.817098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.817536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.818824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.819479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.819912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.876051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:19.876796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:19.884896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.885332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.885817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:19.886555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:19.887022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:19.887484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.051926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.063623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32a0eb46-407a-4e30-8e29-4deb19c93ca5 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.192389 Sep 06 12:16:20.064224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1990/4017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:19 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:20.183424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:20.184163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:20.191588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:20.192262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:20.192927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.194458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:20.194955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:20.195648 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.216025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.225182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58c8156a-2c8a-4b19-8bc4-565b2c8c20fd tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.419829 Sep 06 12:16:20.225795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2028/4018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:19 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:20.352137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.363647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.363647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.364536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5d67ca16-b88d-4d0c-a8ef-fecd218638bf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.185630 Sep 06 12:16:20.366202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1991/4019] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:20 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:20.586103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:20.586729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:20.588786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:20.594700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:20.595192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:20.595678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.596397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:20.596850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:20.597274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:20.745725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:20.754750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c8bdaf65-fae1-4a6c-b213-15096255d6f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.173516 Sep 06 12:16:20.755360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2029/4020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:21.088662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:21.089206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:21.096432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.096916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.097349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.098072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.098517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.098937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.249827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:21.250456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:21.254140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.258825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.259334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.259777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.260512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.260979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.261410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.268295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3982ca98-65af-4d17-bc0b-959828400697 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.183138 Sep 06 12:16:21.269314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1992/4021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:21 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:21.392572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:21.393257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:21.395264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:21.401058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.401552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.402271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.402989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.403448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.403878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.410045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.426561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee651a8c-e557-4fa4-9cda-c9ef201138cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.180569 Sep 06 12:16:21.438015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2030/4022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:21 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:21.562815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.573575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.575049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.576262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0b03e7a-21f7-4a92-9d18-5404cbb0a1fe tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.187877 Sep 06 12:16:21.576842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1993/4023] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:21 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:21.779246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:21.779862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:21.786048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.786547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.787484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.788189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:21.788649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:21.789078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:21.926854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:21.936966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0272c264-7dc4-4d65-bd63-ae0e343a29d4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161823 Sep 06 12:16:21.937775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2031/4024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:22.310564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:22.311175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:22.319047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.319911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.320704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.322091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.323315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.323719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.454920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:22.455958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:22.467261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.467913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.468359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.469470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.470213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.470931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.478178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:22.486808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6642b5f4-2662-4de8-900a-84f692d26f97 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.180135 Sep 06 12:16:22.487403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1994/4025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:22 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:22.604480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:22.606850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:22.615379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.616243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.616854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.618231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.619009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.619926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.622270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:22.633039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e5b5b960-1280-4545-99d3-c6e4ebe28ed7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.185344 Sep 06 12:16:22.645199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2032/4026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:22 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:22.773439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:22.783107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:22.784567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:22.785877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-91534f79-714f-4f5f-a00a-46df3a22d193 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.187157 Sep 06 12:16:22.786496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1995/4027] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:22 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:22.962963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:22.963589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:22.970226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.970643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.971090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:22.971806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:22.972265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:22.972701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.120501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:23.129497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-595d43fa-1173-4340-b4c4-80b7d55e40a1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.171179 Sep 06 12:16:23.130142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2033/4028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:23.511388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:23.511939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:23.518641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:23.519131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:23.519571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.520273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:23.520732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:23.521166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.661535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:23.663081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:23.670231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:23.670724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:23.671158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.671873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:23.672323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:23.672760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.872265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:23.881971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8daeaafb-8a5b-4e9b-a2ed-bda34475d730 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.226136 Sep 06 12:16:23.882716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2034/4029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:23 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:23.890853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:23.891623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:23.896347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:23.898613 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:23.899183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:23.899684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.900515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:23.901039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:23.901460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:23.907302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6e2a22ff-4bb1-4462-9eba-261190b88e02 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.399845 Sep 06 12:16:23.907898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1996/4030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:23 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:24.040176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:24.048973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:24.050506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:24.051720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-349f3f7a-4cb3-499f-b9d8-6b1bb6d2c006 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165014 Sep 06 12:16:24.052284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2035/4031] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:23 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:24.154034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:24.154669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:24.161030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.161520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.162989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.163724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.164185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.164619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.316724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:24.326975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d9070ce9-67cc-46b3-95b4-daf27eead0c3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.177066 Sep 06 12:16:24.327604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1997/4032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:24.905920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:24.906530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:24.913823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.914305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.914736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.915428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.915875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.916294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.935286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:24.936001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:24.942640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.943222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.944313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:24.945022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:24.945479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:24.945931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.059509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.077294 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-57ed4140-f08f-4bd7-85ad-9ea208dd8d8f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.175265 Sep 06 12:16:25.077981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2036/4033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:24 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:25.082844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:25.083470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:25.090708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:25.091202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:25.091649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.092369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:25.092836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:25.093265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.111286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.119248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-27c47cd0-85ab-4f5b-9432-442f6d26b851 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.187830 Sep 06 12:16:25.119843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1998/4034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:24 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:25.242509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.252445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.253201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.254518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-42d11536-6602-40b2-bc58-5b46c374cb48 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.175729 Sep 06 12:16:25.255088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2037/4035] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:25 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:25.351457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:25.352022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:25.358132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:25.358620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:25.359064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.359776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:25.360231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:25.360666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:25.502000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:25.510957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0743940-a040-4fd5-8842-ce8f9789e0f2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.163486 Sep 06 12:16:25.511549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 1999/4036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:26.103609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:26.104422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:26.111089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.111584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.112033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.112742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.113202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.113628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.143089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:26.143712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:26.151977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.152379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.152818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.153520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.154165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.154679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.280290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.290081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b1d1c85c-f0ed-49a6-9d75-cc4ab2528de9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.190834 Sep 06 12:16:26.290688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2038/4037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:26 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:26.295644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:26.296213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:26.302886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.303409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.303857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.304582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.305040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.305472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.311633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.327235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-38baf7ea-80f4-4b29-94f0-6faf35e4dcbb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.187700 Sep 06 12:16:26.327881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2000/4038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:26 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:26.450843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.461758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.463239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.464472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ea979f8f-148a-4251-94d8-3b0fcb15e3dd tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.172731 Sep 06 12:16:26.465063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2039/4039] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:26 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:26.537135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:26.537851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:26.544239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.544720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.545151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.545885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:26.546333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:26.546754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:26.694069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:26.703048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-036e6baa-6c6a-41c4-8be5-5883174354bf tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170198 Sep 06 12:16:26.703653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2001/4040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:27.316941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:27.317561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:27.325635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.326308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.326786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.327508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.327962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.328394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.359485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:27.360202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:27.368265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.368886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.369456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.370316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.370875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.371396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.492631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.501504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-954350ea-4c27-458e-b5f2-c68c0782a27b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.188683 Sep 06 12:16:27.502290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2040/4041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:27 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:27.508333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:27.509455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:27.515616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.516113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.516555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.517274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.517760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.518195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.584029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.604995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e21c8c92-4960-4428-a3a6-f9f21aa48617 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.245364 Sep 06 12:16:27.604995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2002/4042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:27 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:27.675901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.685602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.687118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.688301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c184e86e-087e-4fc9-9255-57921faea182 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.185078 Sep 06 12:16:27.688872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2041/4043] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:27 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:27.726948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:27.727594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:27.733773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.734265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.734704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.735403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:27.735861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:27.736286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:27.881341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:27.883880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:27.892031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-80dd61c7-af93-4bc3-93d8-d3c69cba42c5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168945 Sep 06 12:16:27.892637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2003/4044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:28.544329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:28.544887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:28.551683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.552174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.552616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.553974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.554440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.554871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.625870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:28.626508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:28.634225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.635755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.635755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.635985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.636313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.636753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.722713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:28.731330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-999de06d-ec29-49af-a2b5-743c4b0b395a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.190862 Sep 06 12:16:28.731928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2042/4045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:28 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:28.736561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:28.737254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:28.743578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.744037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.744465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.745155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.745608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.746047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.762257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:28.787768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:28.796858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cac106a1-4fce-4946-959e-dc0b4e05f9b4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.175547 Sep 06 12:16:28.797427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2004/4046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:28 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:28.890869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:28.901419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:28.903189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:28.904340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-367dac8a-6711-4cdf-b430-6c93d562fe3b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171489 Sep 06 12:16:28.904908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2043/4047] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:28 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:28.916403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:28.917028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:28.923117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.923624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.924747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:28.924747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:28.925183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:28.925611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.072937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:29.084731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-40a39111-ae35-4ad6-8171-40142d6ddae2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.172168 Sep 06 12:16:29.085489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2005/4048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:29.756013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:29.756661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:29.763469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:29.763965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:29.764405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.765111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:29.765568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:29.766023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.821377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:29.822034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:29.828692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:29.829183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:29.829625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.830353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:29.830809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:29.831241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.904122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:29.913551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c924f54b-1b2c-4f61-9f82-3bcba982ca34 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162127 Sep 06 12:16:29.914173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2044/4049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:29 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:29.937086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:29.937910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:29.945116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:29.945614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:29.946119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.946990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:29.947447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:29.947880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:29.975843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:29.984301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-af98e600-edcf-4939-b77b-f087d650adec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167701 Sep 06 12:16:29.984916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2006/4050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:29 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:30.087059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:30.095819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:30.097317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:30.098876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c5144d62-2824-4ecc-942b-582d2060416d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165851 Sep 06 12:16:30.100603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2045/4051] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:29 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:30.108784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:30.109470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:30.117119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:30.117612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:30.118072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:30.118974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:30.119451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:30.120040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:30.258157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:30.266717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-33bf5737-9e01-436b-980c-09089df54a61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162147 Sep 06 12:16:30.267299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2007/4052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:30.939376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:30.940125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:30.947397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:30.947882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:30.948312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:30.949027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:30.949734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:30.950208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.010026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:31.010694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:31.017532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.018054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.018494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.019207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.019663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.020123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.102608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.111658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f75d586b-5b36-43b1-8a26-1bb8481a9fa7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.176065 Sep 06 12:16:31.112218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2046/4053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:30 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:31.146298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:31.147176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:31.154574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.155323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.155846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.156583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.157084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.157523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.174199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.194032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15afee6f-43b1-4c0c-a63c-cbbc13c85bb4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.180559 Sep 06 12:16:31.194032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2008/4054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:31 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:31.290973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:31.291695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:31.297776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.298382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.298910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.299628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:31.300088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:31.300517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:31.316253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.325895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.327336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.328499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c933620f-ad10-47c4-b577-0604750a9a36 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.186815 Sep 06 12:16:31.329061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2047/4055] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:31 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:31.443965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:31.452496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9906dac-fa96-4046-99be-850e138106ed tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165613 Sep 06 12:16:31.453083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2009/4056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:32.136224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:32.137736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:32.143989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.144484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.144928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.145632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.147480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.147480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.226534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:32.228188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:32.237068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.237898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.238440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.239464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.240239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.241116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.338063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.357454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-effc6b8d-a1d9-48f8-a4b8-f625cadfa267 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.224687 Sep 06 12:16:32.358679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2048/4057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:32 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:32.368805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:32.370202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:32.382532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.382532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.382847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.383881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.384725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.385512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.451520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.468362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-008d6dec-1178-49b9-9572-990f7bd93d25 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.246749 Sep 06 12:16:32.469427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2010/4058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:32 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:32.476895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:32.477608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:32.484914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.485415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.485887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.486605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:32.487069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:32.487494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:32.629747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.641230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.642828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.644373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a4bfbb3-dc26-4bcb-bdee-74fe98436b47 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.283936 Sep 06 12:16:32.645151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2049/4059] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:32 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:32.650821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:32.659918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4b132d59-3043-4d6e-a7d8-a34f4bdeb992 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.187721 Sep 06 12:16:32.660800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2011/4060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:33.387710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:33.388970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:33.397379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.397911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.398351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.399100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.399562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.400003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.497428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:33.498845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:33.506645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.507165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.507620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.508396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.508853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.509290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.562989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.573595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6db01a75-6f6c-47ff-a833-24b29434b9dc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.189826 Sep 06 12:16:33.574242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2050/4061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:33 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:33.656412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.666786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a127faa1-83a9-49f2-b559-18e287f03a94 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173309 Sep 06 12:16:33.667384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2012/4062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:33 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:33.670967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:33.671587 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:33.678919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.679417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.679851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.680564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.681018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.681438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.686680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:33.687305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:33.694365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.694862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.695322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.696055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:33.696522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:33.696953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:33.861104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.871545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.872233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.873748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:33.875069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-419753e8-6c90-483e-80dc-c6f959e648fa tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.208431 Sep 06 12:16:33.875650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2051/4063] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:33 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:33.881497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c4c5cdf8-979d-4d23-bfab-d7d348894679 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.198401 Sep 06 12:16:33.882310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2013/4064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:34.610389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:34.611103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:34.618268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.618759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.619241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.619952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.620471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.620841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.694040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:34.695074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:34.702414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.702919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.703365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.704089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.704551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.704984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.775233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:34.784738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a9826c5-ea33-474d-803d-e35aa73b78cc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.178927 Sep 06 12:16:34.785342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2052/4065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:34 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:34.871689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:34.881130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e59cff56-563e-4571-8142-6423eb964d00 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.191401 Sep 06 12:16:34.881755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2014/4066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:34 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:34.900690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:34.901329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:34.906619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:34.907250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:34.908581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.909089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.909526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.910312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.910785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.911214 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.914073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.914572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.915019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:34.915744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:34.916204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:34.916640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.077937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.086346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5c0f95d2-7a18-4acd-9292-5961bf03bb3f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.184517 Sep 06 12:16:35.086936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2015/4067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:35.088298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.097511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.099405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.100300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c605334-d8d8-4065-997c-4bb54c67d7e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.203630 Sep 06 12:16:35.100893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2053/4068] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:34 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:35.808309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:35.808857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:35.815410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.815883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.816347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.817034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.817481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.817934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.905348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:35.906065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:35.914109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.914709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.915220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.916080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:35.916615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:35.917215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:35.962916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:35.971653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7531b1c1-0ae6-45a6-bcb8-bf3b6b303079 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167159 Sep 06 12:16:35.972247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2016/4069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:35 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:36.065310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:36.074708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9af53781-1b19-43ff-8470-bc79ee0fdba3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.173668 Sep 06 12:16:36.075296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2054/4070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:35 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:36.110511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:36.111212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:36.118253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:36.118854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:36.119399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:36.120166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:36.120765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:36.121295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:36.137221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:36.138888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:36.144569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:36.145067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:36.145503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:36.147363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:36.147887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:36.148332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:36.274379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:36.283126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5bf17458-ccfc-4b49-a45a-6974919009b4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.176554 Sep 06 12:16:36.283851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2017/4071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:36.315046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:36.323922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:36.325377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:36.326619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-40635cd5-1859-42b0-868b-0644d1af40d5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.193431 Sep 06 12:16:36.327190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2055/4072] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:36 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:36.995941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:36.996588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:37.003130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.003614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.004054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.004756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.005728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.006161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.099158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:37.099899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:37.106515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.107006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.108384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.108384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.108626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.109056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.155833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.165036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2cd2a628-1858-42a1-bbe2-20d18c8ca147 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172949 Sep 06 12:16:37.165670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2018/4073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:36 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:37.266551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.275195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e78d3a01-6101-489d-a6ec-6126d5d961e9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.179876 Sep 06 12:16:37.275779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2056/4074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:37 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:37.308232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:37.308852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:37.315253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.315788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.316308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.317488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.317686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.318689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.355768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:37.356448 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:37.364484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.366078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.366542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.367259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:37.367719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:37.368144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:37.465760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.475045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6fbb255-07dd-4d16-981e-bd859598fce2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170764 Sep 06 12:16:37.475745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2019/4075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:37.511826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.527186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.528617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:37.529829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50720a0e-6342-4160-9b4c-016890b0ca60 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.181104 Sep 06 12:16:37.530390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2057/4076] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:37 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:38.189273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:38.190038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:38.197564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.198087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.198518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.199218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.199667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.200088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.218597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:38.299922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:38.300659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:38.307958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.308452 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.308885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.309581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.310068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.310490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.357527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:38.367919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-53ace3cf-cb3b-4b10-8d5a-1f4b15517a25 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.183176 Sep 06 12:16:38.368831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2020/4077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:38 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:38.481266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:38.496641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-86722792-55a4-4677-8640-a32e3730c6b9 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.200064 Sep 06 12:16:38.497859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2058/4078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:38 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:38.498470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:38.499097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:38.506826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.507349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.507788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.508506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.508962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.509387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.558829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:38.559599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:38.566045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.566535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.566963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.567664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:38.568697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:38.569121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:38.681578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:38.690661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f908ce4d-7df0-4e30-9f66-77fed18d4755 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.196028 Sep 06 12:16:38.691250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2021/4079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:38.743023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:38.752506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:38.754630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:38.756178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a25858f5-675d-4d39-ae33-7c01adc3d24a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.204288 Sep 06 12:16:38.756784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2059/4080] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:38 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:39.392733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:39.393406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:39.401088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.401577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.402305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.403005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.403483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.403917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.522109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:39.522872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:39.532009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.532934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.533596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.534441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.534851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.535283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.538520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:39.569553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:39.581576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-acc2d66d-dfe8-4692-8afa-897b5cf9b925 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.192287 Sep 06 12:16:39.582590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2022/4081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:39 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:39.719078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:39.724930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:39.725547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:39.728536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b6c8cdda-0c89-4ad5-b582-297945a8b535 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.211210 Sep 06 12:16:39.729135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2060/4082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:39 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:39.732154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.732635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.733068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.733808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.734262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.734693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.783272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:39.784045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:39.791145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.791758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.792283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.793109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:39.795313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:39.795313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:39.952358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:39.964187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5cfc6a83-12ee-4014-af1d-f3a8d731241d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.243235 Sep 06 12:16:39.965519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2023/4083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:39.987829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:39.998252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:39.999733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:40.000949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f14ceb3-c912-43cc-a35a-ac4afc591fca tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.221791 Sep 06 12:16:40.001539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2061/4084] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:39 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:40.607684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:40.608279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:40.615283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:40.615771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:40.616215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:40.616928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:40.617388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:40.617856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:40.757417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:40.758623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:40.759251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:40.765935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:40.766208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f937447a-0cd4-4304-a95e-86c00a066139 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162579 Sep 06 12:16:40.766419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:40.767250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2024/4085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:40 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:40.767398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:40.767555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:40.768007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:40.768426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:40.929126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:40.943567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-221c2b4b-0479-4c89-aba0-d94dd74d36c4 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.188613 Sep 06 12:16:40.944679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2062/4086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:40 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:40.994636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:40.995289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:41.001779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.002273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.002712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.003423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.003886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.004316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.033052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:41.033691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:41.040835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.041328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.041793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.042509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.042960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.043384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.179132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:41.188377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d3139f92-a69f-4f98-be81-e1eb6297e76d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.198243 Sep 06 12:16:41.188975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2025/4087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:41.226883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:41.236262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:41.237768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:41.238987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f7330097-e4b0-4d18-b229-1e9d7ea3e08c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.209976 Sep 06 12:16:41.240148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2063/4088] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:41 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:41.790627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:41.791272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:41.798012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.798506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.798947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.799656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.800115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.800544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.944793 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:41.954702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b6425bd-d557-4228-89bc-357d4d165870 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.167790 Sep 06 12:16:41.955041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2026/4089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:41 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:41.984347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:41.984948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:41.992370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.992943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.993382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:41.994116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:41.994565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:41.994989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.137341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:42.146116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3273cd92-7b1c-4a82-9791-21b83fecf312 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.165582 Sep 06 12:16:42.146703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2064/4090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:41 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:42.213769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:42.214397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:42.220662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.221150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.221587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.222333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.222792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.223219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.264691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:42.265319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:42.272955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.273451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.273936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.274644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.275104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.275539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.390550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:42.401235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9645f77f-dcfe-41c3-9c32-7cb77ebd24a9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.192400 Sep 06 12:16:42.403470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2027/4091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:42.457042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:42.466687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:42.468138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:42.469333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2ce3e0b1-e81c-4ab5-a0df-3ed9f3b387b0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.208710 Sep 06 12:16:42.469935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2065/4092] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:42 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:42.979630 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:42.980254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:42.987155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.987662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.988118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:42.988840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:42.989308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:42.989898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.125886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:43.126765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:43.138809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.139752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.140543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.141927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.142700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.143471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.154801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.164440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae5ec92a-d5e5-434d-9ff9-d3609d13919a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.188716 Sep 06 12:16:43.165356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2028/4093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:42 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:43.170585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:43.171200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:43.178613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.179115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.179556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.180282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.180870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.181340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.185899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:16:43.298076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d36ad6a-4c55-44cc-a571-ca6036a741da tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 204 len: 0 microversion: 2.1 time: 0.178751 Sep 06 12:16:43.299213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2066/4094] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:16:43 2022] DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:16:43.313134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:43.314476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:43.325918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.326797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.327324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.328479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.329309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.330249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.350727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.359702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8be4e303-7019-449c-a998-111a06fc68d3 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.192801 Sep 06 12:16:43.361225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2029/4095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:43 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:43.430486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:43.431222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:43.437598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.438294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.438957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.439695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.440168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.440733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.513991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.523191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7555e6cb-477d-4d0e-8a5a-883f02392b08 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1719 microversion: 2.1 time: 0.216399 Sep 06 12:16:43.523789 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2067/4096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:43.534030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:43.534030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:43.541366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.541366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.541366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.541366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:43.542523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:43.542523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:43.608708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.617589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c8aaef84-d9f3-43b4-afac-2026e4e55361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.191081 Sep 06 12:16:43.625720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2030/4097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:43.711790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.720881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.722391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:43.723597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4b42489-65f8-4c8c-9014-32e5cbeea73b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.198785 Sep 06 12:16:43.724175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2068/4098] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:43 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:44.189376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:44.190028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:44.198043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.198531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.198965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.199682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.200144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.200571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.357572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.366976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ebaba17-e742-421d-9906-378bea77ba22 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.181552 Sep 06 12:16:44.367575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2031/4099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:44 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:44.390901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:44.391546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:44.400380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.401014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.402068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.403169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.403913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.404651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.557246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:44.558379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:44.560086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.564575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.565062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.565490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.566391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.566675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.567229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.569311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-919f3ca3-10d3-4278-8869-2544a04bfa91 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.182228 Sep 06 12:16:44.570063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2069/4100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:44 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:44.657918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:44.658634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:44.669512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.670397 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.671169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.672592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.673282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.674075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.741898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.752451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8569ce7d-7b08-43d2-be9d-8304d6ca8805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1719 microversion: 2.1 time: 0.199018 Sep 06 12:16:44.752971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2032/4101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:44.759372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:44.759994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:44.767406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.767890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.768337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.769057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:44.769514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:44.769985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:44.928375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.939231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.941369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.944467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-38e0cde1-e243-49db-bc6f-c16896a5d023 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.190295 Sep 06 12:16:44.945475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2033/4102] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:44 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:44.983454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:44.992812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e99d61ef-f08d-49cc-bf6c-61143756ee62 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.342654 Sep 06 12:16:44.993432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2070/4103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:45.393362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:45.394121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:45.402184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.402681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.403128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.403925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.404401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.404809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.574620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:45.585357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2298932e-0366-453a-b9fc-bd901b8d5b1c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.197504 Sep 06 12:16:45.586174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2034/4104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:45 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:45.594700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:45.595458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:45.602260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.602872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.603319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.604046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.604510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.604934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.779641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:45.780980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:45.793163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.797499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.797499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.797499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:45.797499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:45.798517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:45.855070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:45.867792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a4bd4b1-7583-434f-b66d-3ddf7eca56a6 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.277609 Sep 06 12:16:45.871780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2071/4105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:45 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:45.978710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.011356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a7894b82-62d3-4959-93e9-b4cb6a1de73d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1651 microversion: 2.1 time: 0.226331 Sep 06 12:16:46.012577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2035/4106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1651 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:46.015886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-3ec35d21-2dea-4956-a71f-d5990cb5c1f3 req-5186baa0-9145-4bd2-a0e6-6a63901b28e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2942181c-63de-4194-946d-9d8ca5c4b4a3", "name": "network-vif-deleted", "tag": "429d5db2-cf15-4c0a-adeb-c7310ca25fc9"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:16:46.035096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-3ec35d21-2dea-4956-a71f-d5990cb5c1f3 req-5186baa0-9145-4bd2-a0e6-6a63901b28e5 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.035466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-3ec35d21-2dea-4956-a71f-d5990cb5c1f3 req-5186baa0-9145-4bd2-a0e6-6a63901b28e5 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.036646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-3ec35d21-2dea-4956-a71f-d5990cb5c1f3 req-5186baa0-9145-4bd2-a0e6-6a63901b28e5 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.040864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:46.045003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:46.057950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-3ec35d21-2dea-4956-a71f-d5990cb5c1f3 req-5186baa0-9145-4bd2-a0e6-6a63901b28e5 service nova] Creating event network-vif-deleted:429d5db2-cf15-4c0a-adeb-c7310ca25fc9 for instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 on hv-cinder-85604 Sep 06 12:16:46.066330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.067267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.068444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-3ec35d21-2dea-4956-a71f-d5990cb5c1f3 req-5186baa0-9145-4bd2-a0e6-6a63901b28e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145925 Sep 06 12:16:46.071145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.072434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.074270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2072/4107] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:16:46.078833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.079558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.084179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:46.085966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:46.096615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.097428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.098207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.100018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.100820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.101550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.294657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.312644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.315367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.317299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc55785a-2aea-454e-a7f5-0fd11b1bae94 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.300346 Sep 06 12:16:46.318946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2036/4108] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:46 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:46.319162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.327929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34c91a5b-466c-473e-a444-e6b45ccda540 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.251813 Sep 06 12:16:46.328690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2073/4109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:46.610903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:46.611712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:46.618459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.618947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.619599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.620316 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.620776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.621200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.624324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:46.793616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:46.804127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bf8e0e23-6436-4c8a-b16d-590d35280b89 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.197015 Sep 06 12:16:46.804739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2037/4110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:46 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:46.916596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:46.917875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:46.930673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.931567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.932373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:46.933675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:46.934490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:46.935232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.053441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:47.054410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:47.061389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.061975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.062437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.063436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.063915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.064349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.116662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.126565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-966775b3-fcb6-42a4-97c2-444ff9db5160 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.217561 Sep 06 12:16:47.127313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2074/4111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:46 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:47.150910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.160709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4e0314a-aa55-4782-afd2-c921366dade1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.112291 Sep 06 12:16:47.162001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2038/4112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:47.353479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:47.354741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:47.354921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:47.355747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:47.362088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.362577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.363040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.363758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.364205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.364895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.365019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.365100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.365444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.366198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.366723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.367099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.526093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.528928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:47.538687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.540361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.541617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-47a2a673-2a39-4d4d-bf7b-0811afcce141 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.196463 Sep 06 12:16:47.542232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2075/4113] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:47 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:47.547857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:47.557081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-548d9f71-6577-427a-b5ae-0573ad4a93e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.208246 Sep 06 12:16:47.557894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2039/4114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:47.838453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:47.839297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:47.841743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:47.848110 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.848648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.849121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.849882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:47.850352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:47.850787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:47.997512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.006821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2645e6c0-f44f-4099-a006-2ac86dde4cde tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172136 Sep 06 12:16:48.007423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2076/4115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:47 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:48.155094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:48.156335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:48.168324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.169212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.170102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.171325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.172175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.176007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.188272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:48.189090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:48.195709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.196116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.196547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.197245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.197727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.198161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.263472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.272445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-128c906e-ea28-4cff-afd3-307006e356f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087976 Sep 06 12:16:48.273170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2077/4116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:48.328305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.337092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f4177085-ad34-490c-8e3d-ded36e82f2ec tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.189470 Sep 06 12:16:48.337931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2040/4117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:48 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:48.580550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:48.581074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:48.583259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:48.584304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:48.587908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.588404 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.588841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.589549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.590032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.590352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.590513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.590831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.591264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.591960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:48.592406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:48.592832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:48.734592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.740561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.744542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.746098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:48.747301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4a514a84-f33f-4148-8fc1-79704387af05 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.167957 Sep 06 12:16:48.747872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2041/4118] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:48 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:48.749769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4d4f8118-a989-407a-9e58-e167b2dee4ca tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.173184 Sep 06 12:16:48.750346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2078/4119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:49.030855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:49.031477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:49.038753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.039254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.039698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.040415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.040874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.041301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.199171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.208708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-95d1e2de-d9d1-45de-aff1-eb8e60598072 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.181414 Sep 06 12:16:49.209304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2042/4120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:49 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:49.303744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:49.304319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:49.311186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.311685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.312127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.312877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.313336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.313803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.362174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:49.362950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:49.365844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:49.372677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.373163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.373631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.374367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.374824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.375466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.383874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.392421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-00a72f9b-b7f8-4f45-8aeb-25bd31e8e55f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093291 Sep 06 12:16:49.393216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2079/4121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:49.515452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.524581 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f32ec754-0630-4ff6-91b6-5cb8d7fb6a37 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.167721 Sep 06 12:16:49.525160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2043/4122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:49 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:49.774850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:49.775135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:49.775470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:49.775753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:49.786585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.786585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.786585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.786585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.787316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.787316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.787597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.787597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.787597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.788032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:49.788274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:49.788703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:49.936800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.953053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.954701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.955681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:49.956111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-03b3898e-1db4-40cc-a713-f3825f8786ff tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.186735 Sep 06 12:16:49.956773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2080/4123] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:49 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:49.971326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-46ca868a-770e-4cc0-9682-b94abc3c2a0b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.199609 Sep 06 12:16:49.972360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2044/4124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:50.233890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:50.234419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:50.240504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.240991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.241419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.242142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.242593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.243011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.391418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:50.402381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09dbff9a-e6d2-47e2-8c10-5e9dd89b6928 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.172126 Sep 06 12:16:50.402984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2081/4125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:50 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:50.417306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:50.418064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:50.425018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.425507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.425978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.426749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.427241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.427665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.502800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:50.512461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1391e7e3-d8c1-4496-a2bb-0b7cc9c7303a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.099145 Sep 06 12:16:50.513063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2045/4126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:50.548833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:50.549703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:50.557453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.558032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.558503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.559377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.559942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.560419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.711683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:50.720597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a72232b5-ce44-4b89-ba53-84470c215f2d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.175809 Sep 06 12:16:50.721259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2082/4127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:50 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:50.984855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:50.985669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:50.995725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.996279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.996963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:50.997903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:50.998617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:50.999338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.007360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:51.007985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:51.014189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.014673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.015114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.015824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.016286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.016711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.148940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.158819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.160301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.161634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-044ff633-092f-4c24-b0f7-1836b1fe565b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.182137 Sep 06 12:16:51.162242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2046/4128] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:50 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:51.172693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.181843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4a5e91b8-48e0-40d5-ac3d-113518a5d5ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.179896 Sep 06 12:16:51.182624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2083/4129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:51.426149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:51.427385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:51.434427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.434907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.435635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.436209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.436685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.437145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.541486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:51.542866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:51.554585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.555465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.556220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.557472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.558335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.559097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.583488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.593116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2052cc6a-1485-488a-b29c-432c1ebcdc5a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.171072 Sep 06 12:16:51.593736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2047/4130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:51 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:51.640792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.649528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4b819b7-1d84-485b-8e4f-24b9fa9d1426 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.116035 Sep 06 12:16:51.650171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2084/4131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:51.745670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:51.746378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:51.752612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.753102 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.753540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.754282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:51.754780 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:51.755226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:51.910759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:51.920146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-99fe23d2-f6bc-4bcb-9373-cb852f27c4e1 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.178331 Sep 06 12:16:51.920734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2048/4132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:51 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:52.191559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:52.192213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:52.198652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.199145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.199582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.200295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.200846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.201277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.205922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:52.206763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:52.213725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.214223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.214659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.215356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.215811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.216237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.349911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.352344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.358826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.360289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.360547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2cfeff30-7893-4de9-97f0-edd881b05361 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158622 Sep 06 12:16:52.361131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2049/4133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:52 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:52.361463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58e57a19-4657-44a2-8e89-a25facca3a13 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.173794 Sep 06 12:16:52.362052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2085/4134] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:52 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:52.625843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:52.626503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:52.633094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.633587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.634058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.634763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.635221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.635650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.677597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:52.678296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:52.684687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.685176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.685611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.686331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.686786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.687211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.750637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.759468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-91a55004-c9a1-45e5-9a2e-8b51d16f54d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085995 Sep 06 12:16:52.760052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2086/4135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:52.771285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:52.779711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba3aac70-ae76-4336-8d51-6f2927047316 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157978 Sep 06 12:16:52.780269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2050/4136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:52 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:52.945638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:52.946263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:52.952718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.953211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.953675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:52.954398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:52.954862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:52.955292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.092018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.101281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8fae2cdd-78ca-4baf-88db-99db5caebb8f tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.159899 Sep 06 12:16:53.101911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2087/4137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:52 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:53.385113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:53.385763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:53.386895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:53.387514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:53.391886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.392368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.392807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.393401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.393512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.393922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.394022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.394353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.394459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.395067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.396209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.396635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.529197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.531209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.539707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de59c74f-0390-4ccb-beec-e9d45bbfcff1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158528 Sep 06 12:16:53.540300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2051/4138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:53.541067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.542723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.544004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b99e354d-99ed-4729-952d-34a7203f4695 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.161043 Sep 06 12:16:53.544569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2088/4139] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:53 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:53.783427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:53.783960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:53.790573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.791067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.791501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.792229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.792684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.793110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.803617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:53.804221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:53.810896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.811388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.811826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.812533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:53.812988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:53.813418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:53.856507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.865879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de5f57e7-0eb7-4683-a495-a4bc44306b02 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086025 Sep 06 12:16:53.866480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2052/4140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:53.950738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:53.961574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6e94cf55-b7d3-409d-8274-de5c5f4162ce tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162209 Sep 06 12:16:53.962198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2089/4141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:53 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:54.124739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:54.125310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:54.131504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.131999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.132437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.133156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.133616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.134076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.278692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.280877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:54.289141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3be57233-f3fa-4985-83ff-b17d37027c9d tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.168377 Sep 06 12:16:54.289743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2053/4142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:54 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:54.565204 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:54.566175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:54.572360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:54.573183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:54.573487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.574020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.574461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.575180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.575644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.576070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.580365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.581046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.581569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.582424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.583115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.583824 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.721020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.730112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-38c2ba3d-47b0-4a5c-b788-791579c07453 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168885 Sep 06 12:16:54.730706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2090/4143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:54.731388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.741350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.742840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.744259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9106d479-7910-412e-b76c-567b22c17477 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.177371 Sep 06 12:16:54.744733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2054/4144] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:54 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:54.889683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:54.890218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:54.897097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.897577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.898040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.898757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.899216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.899639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.963251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:54.971568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4466b4e0-31f9-43fb-a37c-e7d2c3e9c466 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085812 Sep 06 12:16:54.972131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2091/4145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:54.985485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:54.986145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:54.993307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.993846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.994287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:54.994986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:54.995442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:54.995873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.134087 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.142560 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-47b4f439-e59d-433e-936d-807134057f6a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.160838 Sep 06 12:16:55.143073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2055/4146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:54 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:55.313417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:55.314053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:55.320085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.320562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.321056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.321761 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.322212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.322662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.337756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:55.455128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.464590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-17e43153-44c6-4372-ac53-26ddbe6cd6cf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155128 Sep 06 12:16:55.465158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2092/4147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:55 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:55.754465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:55.755607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:55.761548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.762091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.762500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.763181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.763633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.764055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.771292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:55.772033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:55.778430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.778916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.779357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.780084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:55.780552 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:55.780983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:55.902151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.910942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-767e3d61-44a8-4261-b9ad-614f5dcabec2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160225 Sep 06 12:16:55.911633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2056/4148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:55.920538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.930151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.931652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:55.932829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2b6a1caf-d6d0-439e-9117-9b691ae5601d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166320 Sep 06 12:16:55.933375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2093/4149] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:55 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:55.996222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:55.996840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:56.004384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.005457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.005936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.006654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.007113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.007544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.070458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:56.080196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37cf6849-ba67-44ef-ac8d-1cda0b643e0a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087860 Sep 06 12:16:56.080773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2057/4150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:56.167439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:56.167977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:56.174119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.174609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.175049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.175740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.176196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.177290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.307965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:56.316327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-39bf0633-0bc9-4662-b04c-9e6bb07d7cd9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152827 Sep 06 12:16:56.316902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2094/4151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:56 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:56.487982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:56.488505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:56.495519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.496007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.496466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.497155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.497614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.498070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.653585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:56.662426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ce2c5e2c-a10f-4eb8-806d-9b0e6cd5be75 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.178358 Sep 06 12:16:56.663020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2058/4152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:56 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:56.934450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:56.935057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:56.940944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.941424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.941886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.942750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.943195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.943616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.960745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:56.961357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:56.967529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.968013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.968445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:56.969171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:56.969622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:56.970078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.110423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.121530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.123030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.124233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c1c3d3a5-e788-461b-b13d-c5626b048925 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.168709 Sep 06 12:16:57.124794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2059/4153] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:56 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:57.129413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:57.130042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:57.136493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:57.136967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:57.137400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.138147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:57.138599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:57.139018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.204627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.213444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-820c0a50-f901-4539-add0-416cc739780b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087581 Sep 06 12:16:57.214071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2060/4154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:57.325456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.334546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5080e7ce-9c6f-4f05-9bae-2bfd76564ace tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.404066 Sep 06 12:16:57.335425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2095/4155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:57.340341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:57.340978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:57.346828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:57.347309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:57.347744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.348997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:57.349465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:57.349915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.480884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.489386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8bb6cab8-832c-4d0c-93c6-c50c952f1ed2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152675 Sep 06 12:16:57.490026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2061/4156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:57 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:57.686813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:57.687355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:57.694183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:57.694663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:57.695097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.695786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:57.696237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:57.696660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:57.826483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:57.835534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-081cb2ce-6384-4e79-951b-a87df7a073eb tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.152700 Sep 06 12:16:57.836112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2096/4157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:57 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:58.152340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:58.152869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:58.159333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.159814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.160244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.160929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.161377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.161867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.237807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:58.238436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:58.245534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.246052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.246480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.247345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.247802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.248217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.296881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:58.306145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:58.307752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:58.308944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d74d041c-2c46-478c-b5ce-bcda5d8467fc tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.160840 Sep 06 12:16:58.309517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2062/4158] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:58 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:16:58.312787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:58.322218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-520c0559-3078-49fc-bf63-eceadf7d7d83 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088240 Sep 06 12:16:58.322778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2097/4159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:58.358472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:58.359084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:58.365754 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.366376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.366830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.367523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.368004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.368407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.509338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:58.513182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:58.513843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:58.519944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.520435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.520873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.521687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.522180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.522610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.523640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c311f342-4ae5-44d0-99ba-b5aabda785b9 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168957 Sep 06 12:16:58.524225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2063/4160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:58 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:58.656894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:58.666059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4b501613-251c-4217-976c-f5a2951aa389 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157383 Sep 06 12:16:58.666655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2098/4161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:58 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:58.859145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:58.859663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:58.865612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.866112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.866541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.867214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:58.867666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:58.868084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:58.998758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.007138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4fe71bfa-66fb-4f30-bb33-ff4873014a53 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.151896 Sep 06 12:16:59.007713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2064/4162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:58 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:59.336006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:59.336622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:59.343598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.344091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.344562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.345295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.345794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.346226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.346626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:59.347248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:59.354185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.354711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.355296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.356036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.356517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.356961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.423846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.433320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0fa3875c-361f-430a-bcb2-ccb10afc13c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090496 Sep 06 12:16:59.433945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2065/4163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:16:59.484193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.493263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.494768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.495952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d0a21dad-9c0e-49ba-ad97-8004e51294e2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.164924 Sep 06 12:16:59.496519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2099/4164] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:16:59 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:16:59.549075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:59.549593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:59.557291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.557816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.558260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.558959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.559416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.559843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.691440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:16:59.692201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:16:59.699300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.699489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.699794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.700265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.700968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:16:59.701421 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:16:59.701903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:16:59.708014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e684c225-896f-4585-b6bf-1c88eccb6d46 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162836 Sep 06 12:16:59.708791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2066/4165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:16:59.854205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:16:59.863569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6d36705-03e4-4c6d-b21b-3f96ba77d513 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.177744 Sep 06 12:16:59.864157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2100/4166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:16:59 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:00.031112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:00.031715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:00.038481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.038987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.039419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.040103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.040546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.040963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.172464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:00.182010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-53594b01-2a36-4083-84a6-bee30d9c0b08 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.155050 Sep 06 12:17:00.182594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2067/4167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:00 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:00.458170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:00.459343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:00.465877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.466358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.466793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.467477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.467927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.468350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.522800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:00.523440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:00.532196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:00.533357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.533887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.534340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.535051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.535512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.535946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.541715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b6249bd3-959d-4946-91dd-9f2d561bfe75 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087282 Sep 06 12:17:00.542358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2101/4168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:00.683355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:00.692238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:00.694319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:00.695444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fe221778-66b7-4b72-a47f-8809c45e1d38 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.177446 Sep 06 12:17:00.696104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2068/4169] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:00 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:17:00.731798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:00.732369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:00.738625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.739111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.739547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.740918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.741388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.741842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.873558 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:00.882458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0609c58c-0fb3-4d3f-9edb-4209475d538a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154613 Sep 06 12:17:00.883029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2102/4170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:00.887713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:00.888338 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:00.894285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.894766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.895200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:00.895881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:00.897550 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:00.898209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.039350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:01.047755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-74a19486-d2e5-46ce-8aa3-ec0fa812b3f4 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.163867 Sep 06 12:17:01.048329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2069/4171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:00 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:01.205964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:01.206614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:01.213066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.213606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.214092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.214842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.215323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.215748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.367747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:01.377268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-01d1f293-eec2-4df5-adcf-67aeed1e22dd tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.175260 Sep 06 12:17:01.377879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2103/4172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:01 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:01.565816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:01.566351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:01.572954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.573445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.573920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.574629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.575091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.575521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.590829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:01.642611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:01.651703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15198901-9982-4891-bb7d-69dcd1f01c46 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089826 Sep 06 12:17:01.652540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2070/4173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:01.722076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:01.722695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:01.730378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.730870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.731311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.732010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.732469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.732898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.865864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:01.874643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:01.876169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:01.877331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a9f08130-ac98-4c44-8806-3001d8f18512 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.159288 Sep 06 12:17:01.877926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2104/4174] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:01 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:01.907513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:01.908081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:01.914701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.915192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.915632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:01.916330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:01.916788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:01.917216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.071786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:02.072685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:02.074884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:02.078868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.079427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.079931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.080699 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.081222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.081739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.083108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-41ea0ead-82ab-4a03-b4fe-bc98fa40a5b0 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.179715 Sep 06 12:17:02.084334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2071/4175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:02.228451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:02.236816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f87860b1-39d8-4b16-a8dd-6edcabf597bc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.168937 Sep 06 12:17:02.237391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2105/4176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:02 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:02.402496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:02.403124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:02.409220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.409743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.410187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.410881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.411341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.413018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.547965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:02.560048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1f76ee42-19a7-448f-a1ab-262a2054357a tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.161579 Sep 06 12:17:02.560873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2072/4177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:02 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:02.676161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:02.676771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:02.683765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.684245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.684678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.685356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.685844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.686264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.754089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:02.763585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3d672c6d-ece9-4a88-9100-cf8ed8bc0da4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091288 Sep 06 12:17:02.764166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2106/4178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:02.903817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:02.904461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:02.911056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.911540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.912653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:02.913361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:02.913865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:02.914305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.052990 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.061904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.063351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.064541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04f28be5-3641-4a93-aa6f-8aed6300a94d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.165006 Sep 06 12:17:03.065109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2073/4179] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:02 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:03.107694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:03.108310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:03.114607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.115192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.115788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.116223 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.116678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.117101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.250925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.264416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:03.265472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-588238f5-d280-4108-a938-65cc6a45585c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161486 Sep 06 12:17:03.265595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:03.266405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2107/4180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:03 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:03.273749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.274241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.274677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.275382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.275842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.276267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.412722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.420952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0de27b1d-b719-40e4-8be4-0b44d2b3303e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.162940 Sep 06 12:17:03.421521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2074/4181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:03 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:03.584956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:03.585597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:03.591612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.592095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.592530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.593230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.593694 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.594138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.732948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.742734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f8eaeac-7f72-4bc4-bcdb-249df48346ef tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162201 Sep 06 12:17:03.743331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2108/4182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:03 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:03.788952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:03.789564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:03.795678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.796169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.796608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.797310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:03.797795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:03.798226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:03.861038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:03.869936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e715867f-1888-47de-9780-0e84395c0c10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085906 Sep 06 12:17:03.870528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2075/4183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:04.090649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:04.091296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:04.097546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.098058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.098498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.099211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.100889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.101325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.104060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:04.234125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.255842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.257312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.259141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89fb61ad-204e-4c52-8ab2-4cd992679ae9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171857 Sep 06 12:17:04.259141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2109/4184] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:04 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:04.291176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:04.291790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:04.298277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.298758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.299201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.299891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.300346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.300768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.445723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:04.446349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:04.449538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.452639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.453606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.453606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.454350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.454735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.455159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.458076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eb3205b6-2eb2-4eb7-aec4-250d663e0938 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.172044 Sep 06 12:17:04.459183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2076/4185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:04.607736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.617741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-68561804-0407-4d39-a48b-c065b4f21f58 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.177003 Sep 06 12:17:04.618346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2110/4186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:04 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:04.766445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:04.767079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:04.773886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.774368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.774800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.775486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.775936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.776358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.893990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:04.894617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:04.901999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.902504 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.902943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.903647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:04.904109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:04.904532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:04.908234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.916553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-577e39ae-780f-4ffa-96d3-12eabea3a1ff tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.153942 Sep 06 12:17:04.917159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2077/4187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:04 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:04.970537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:04.979596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ef31d0f9-5c50-4102-9697-3d505e27af31 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089822 Sep 06 12:17:04.980177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2111/4188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:05.287466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:05.288485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:05.294859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.295522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.295781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.296486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.296998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.297371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.433699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:05.442421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:05.444496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:05.445708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-666d22eb-7222-4857-8c99-4facacbcc4ac tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.162884 Sep 06 12:17:05.446277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2078/4189] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:05.482973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:05.483627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:05.491510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.492001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.492435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.493143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.493592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.494042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.627495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:05.636022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-084ba6c4-be3f-4e3e-acb9-1e9958116c1c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157481 Sep 06 12:17:05.636820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2112/4190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:05.643862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:05.643862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:05.651232 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.651714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.652403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.653103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.653549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.653997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.795664 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:05.803552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b1d58234-ebb3-4c6f-ab28-e9924857f03c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.164238 Sep 06 12:17:05.804132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2079/4191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:05 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:05.940610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:05.941217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:05.948484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.948965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.949392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:05.950109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:05.950555 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:05.950970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.004145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:06.004759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:06.011364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.011843 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.012277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.012973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.013421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.013866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.078007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.087792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb105431-c2ff-4afb-9a3f-3acf42888c8e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087457 Sep 06 12:17:06.088405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2080/4192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:06.097253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.106536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-db0c8225-8ac6-4f8c-8383-8acea0493a85 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.169602 Sep 06 12:17:06.107142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2113/4193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:05 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:06.471320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:06.471976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:06.478819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.479303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.479740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.480435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.480893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.481319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.618727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.627825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.629281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.631013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f3074c96-e285-4431-87ff-d9861dc20195 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.163106 Sep 06 12:17:06.631762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2081/4194] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:06 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:06.660427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:06.661094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:06.667369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.667847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.668292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.668951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.669400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.669854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.801768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.810028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f84df9b2-828c-4d3a-abd2-bdeb8a2b8560 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153478 Sep 06 12:17:06.810672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2114/4195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:06.826647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:06.827252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:06.833153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.834293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.834726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.835405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:06.835853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:06.836272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:06.971501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:06.980248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d1721e63-1f55-496e-a847-8e9b25b958b8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.157309 Sep 06 12:17:06.980845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2082/4196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:06 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:07.111543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:07.112081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:07.119171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.119659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.120098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.120793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.121257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.121711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.130987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:07.132193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:07.138150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.138631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.139063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.139755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.140206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.140628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.184730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:07.193950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d7c14ad-a878-4648-a05c-d8e6547ca399 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085825 Sep 06 12:17:07.194538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2115/4197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:07.275024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:07.283596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-deade860-f300-4945-8f91-ac85a25d6252 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.157020 Sep 06 12:17:07.284170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2083/4198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:07 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:07.657277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:07.657961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:07.670035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.670035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.670035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.670035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.670762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.670762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.812323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:07.821234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:07.822731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:07.823964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e6fad05d-256d-4972-b64a-7c289451b20d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.170851 Sep 06 12:17:07.824525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2116/4199] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:07 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:07.834015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:07.835283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:07.841602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.842124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.842564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.843254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:07.843712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:07.844193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:07.975108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:07.984463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-08f67042-9878-4dc7-82fb-341d1d9e0795 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154369 Sep 06 12:17:07.985055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2084/4200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:08.005924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:08.006484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:08.012501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.012984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.013422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.014131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.014593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.015019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.145229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:08.154807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ff467667-bf6f-4160-b0c8-279ee0a84623 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 200 len: 1729 microversion: 2.1 time: 0.152838 Sep 06 12:17:08.155395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2117/4201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:08 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:08.185511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c71cc7d0-ae13-4df7-9fab-f5b264783417 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '.version_select at 0x7f97f4f2cb80>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:08.209317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c71cc7d0-ae13-4df7-9fab-f5b264783417 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055909117" status: 202 len: 0 microversion: 2.1 time: 0.027571 Sep 06 12:17:08.210756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2085/4202] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 6 12:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055909117 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:17:08.217218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:08.217895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:08.223871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.224383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.224826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.226015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.226530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.226962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.302392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:08.307362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:08.308101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:08.312205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0152ef55-2874-493b-9dc8-b724e255058c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.099014 Sep 06 12:17:08.313809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2118/4203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:08.315112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.315689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.316229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.316939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.317529 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.317996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.457589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:08.466887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b8dd9498-57a9-4c56-9930-69b6df77641c tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.163821 Sep 06 12:17:08.478205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2086/4204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:08 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:08.849978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:08.851916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:08.857977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.858533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.858969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:08.859695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:08.860147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:08.860570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.008395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:09.009034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:09.015382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.015854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.016321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.017045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.017501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.017963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.076914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:09.086708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:09.088391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:09.089723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99b6fdb8-8f5c-4f61-aa3d-ca5b77e5ddc4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.243658 Sep 06 12:17:09.090406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2119/4205] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:08 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:09.155921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:09.164822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-66e26451-53c1-4f38-b44f-634cc04796ab tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160322 Sep 06 12:17:09.165423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2087/4206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:09 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:09.249693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-6b2e2719-6b0a-4e44-9afe-db33d8153d97 req-d2ea2ceb-54f6-4357-8473-2acd863a68eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb205f-f79a-4c52-b0e3-190868135839", "tag": "f1f133bf-a5b0-4fa4-a620-a0a7431dee95"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:09.275076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-6b2e2719-6b0a-4e44-9afe-db33d8153d97 req-d2ea2ceb-54f6-4357-8473-2acd863a68eb service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.275820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-6b2e2719-6b0a-4e44-9afe-db33d8153d97 req-d2ea2ceb-54f6-4357-8473-2acd863a68eb service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.276403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-6b2e2719-6b0a-4e44-9afe-db33d8153d97 req-d2ea2ceb-54f6-4357-8473-2acd863a68eb service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.289253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-6b2e2719-6b0a-4e44-9afe-db33d8153d97 req-d2ea2ceb-54f6-4357-8473-2acd863a68eb service nova] Creating event network-changed:f1f133bf-a5b0-4fa4-a620-a0a7431dee95 for instance 23cb205f-f79a-4c52-b0e3-190868135839 on hv-cinder-85604 Sep 06 12:17:09.295419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-6b2e2719-6b0a-4e44-9afe-db33d8153d97 req-d2ea2ceb-54f6-4357-8473-2acd863a68eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049322 Sep 06 12:17:09.299815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2120/4207] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:09.337462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:09.338659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:09.349401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.350234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.359240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.362331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.362940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.363394 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.377740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:09.463007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:09.472068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c0a305eb-7b91-46f4-a859-5d0ec2929da8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.139250 Sep 06 12:17:09.473227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2088/4208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:09.494664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:09.495922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:09.502067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6f24a0fb-6558-46b4-a03b-16f36dfd2361 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: .version_select at 0x7f97f4e2e430>, body: {"keypair": {"name": "tempest-keypair-1489442040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlm60tK8HGeiiVWofgPXdYIdREn95TIXTI95KR6LiVBiOvi5mZ45tFFXpRFbBC4WqVcXNHWDsEkt7b0hNd/RPArD07dcnvdehAOXmHQw9Dn/CISXY10y28BUZccOM6VFw=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:09.503993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.504707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.505150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.506051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:09.507112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:09.507707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:09.553983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-6f24a0fb-6558-46b4-a03b-16f36dfd2361 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:17:09.562695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-6f24a0fb-6558-46b4-a03b-16f36dfd2361 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:17:09.565946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:09.592596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6f24a0fb-6558-46b4-a03b-16f36dfd2361 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094939 Sep 06 12:17:09.593467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2089/4209] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 12:17:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:09.810027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:09.821375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8275e80e-a387-4102-9129-e5b5deee77ba tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.332467 Sep 06 12:17:09.840572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2121/4210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:09 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:10.118775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:10.120852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:10.128735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.129169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.129631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.130548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.131002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.131446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.189427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:10.191005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:10.199401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.201046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.201764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.202709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.203413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.203989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.363945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:10.374085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:10.384610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:10.386200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:10.386800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-32f586ac-b347-42a2-b5b4-512fd3d8ed50 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.201200 Sep 06 12:17:10.387392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2122/4211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:10.388575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dc8ef14d-9bd5-4af7-bbde-2b6c9487af3c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.275852 Sep 06 12:17:10.408397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2090/4212] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:10 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:10.506950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:10.507662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:10.513990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.514544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.515044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.515819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.516661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.517088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.581589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:10.591285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f7a0d563-2c20-49b2-8b14-1a335a203772 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088340 Sep 06 12:17:10.591879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2123/4213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:10.844832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:10.845444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:10.852379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.852869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.853299 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:10.854033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:10.854482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:10.854904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.152192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:11.160655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-07e9cfcd-6551-418f-baea-249757ac2785 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.319699 Sep 06 12:17:11.161239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2091/4214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:10 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:11.400915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2114941759", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cda860d2-2fe0-49d5-8510-1c9e43ecbe57"}], "security_groups": [{"name": "tempest-securitygroup--1156767783"}], "key_name": "tempest-keypair-1489442040", "user_data": "}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:11.415961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:11.416599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:11.422865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.423146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.423586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.424265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.424712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.425128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.506312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] validate_networks() for [('cda860d2-2fe0-49d5-8510-1c9e43ecbe57', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:17:11.565126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:11.575124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:11.576573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:11.577761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e0787bff-9cda-4bfa-a3be-51519cafa80b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.166205 Sep 06 12:17:11.578327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2092/4215] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:11 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:17:11.582756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:11.583360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:11.591612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.592104 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.592525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.593212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.593679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.594107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.737965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:11.746148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d4f7a54-09af-4bff-8697-a5a4b8c3f760 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166817 Sep 06 12:17:11.746721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2093/4216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:11.758609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:11.759337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:11.765349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.765872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.766303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.766994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.767437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.767854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.839200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:11.848445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-53068456-3316-4ed2-adaa-bee712165a74 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093733 Sep 06 12:17:11.849214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2094/4217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:11.958026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:17:11.958808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:17:11.959382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:17:11.960467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:17:11.960898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:17:11.963326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:11.972015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.972498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.972935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.973689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:11.974151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:11.974578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:11.991213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:17:11.995654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:17:12.007543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:17:12.010052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:17:12.056912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR oslo.messaging._drivers.impl_rabbit [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [01f9c7e6-8b71-4245-a577-e52d324c0788] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:17:12.183834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:12.184450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:12.190866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.191356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.191794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.192481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.192941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.193375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.332692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:12.342383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-be437daf-eae3-4634-b0ba-f772512fa194 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.162348 Sep 06 12:17:12.343024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2095/4218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:12 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:12.604591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:12.605068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:12.611772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.612357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.612894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.613825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.614434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.615003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.745321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:12.754223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:12.755681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:12.757420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de1c21ff-81cb-4352-968c-b82d71f849f0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.157365 Sep 06 12:17:12.758013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2096/4219] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:12 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:17:12.767846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:12.768481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:12.774502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.774981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.775408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.776086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.776533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.777206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.910429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:12.919646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5590ba82-35b9-4b15-9dd5-bc647c0756bd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155411 Sep 06 12:17:12.920220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2097/4220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:12.924575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:12.925269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:12.931524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.932006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.932442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.933122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:12.933576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:12.934028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:12.996848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:13.005023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-60d299d4-b093-47e6-91d9-996dce924b33 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083859 Sep 06 12:17:13.005596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2098/4221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:13.068511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [01f9c7e6-8b71-4245-a577-e52d324c0788] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55072. Sep 06 12:17:13.074571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-764bab9d-12cd-4a02-aac5-538a22f5229d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.678585 Sep 06 12:17:13.075248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2124/4222] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 12:17:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:17:13.087092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e62eaf87-3e4e-4410-a2e9-6d8d15e4ecc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:13.087709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e62eaf87-3e4e-4410-a2e9-6d8d15e4ecc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:13.142314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e62eaf87-3e4e-4410-a2e9-6d8d15e4ecc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:13.150294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e62eaf87-3e4e-4410-a2e9-6d8d15e4ecc9 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1242 microversion: 2.1 time: 0.067307 Sep 06 12:17:13.150886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2099/4223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:13 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:13.365583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:13.366949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:13.374133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:13.375269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:13.376258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:13.376984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:13.377680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:13.378344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:13.552856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:13.563101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27477580-578b-464e-90b8-e49f9d137ecf tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.201718 Sep 06 12:17:13.563769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2125/4224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:13 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:13.783739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:13.784345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:13.792341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:13.793056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:13.793841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:13.795088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:13.795681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:13.796353 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:13.937924 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:13.943064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:13.943682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:13.947981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:13.949478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:13.949868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:13.950342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:13.950781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:13.950900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ae32b4e7-30a4-4d9e-9791-9a5b1dc8d1e5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 200 len: 1801 microversion: 2.20 time: 0.171168 Sep 06 12:17:13.951389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2100/4225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:13 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:13.951511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:13.951915 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:13.952338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.030095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:14.030777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:14.039123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:14.039627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:14.040071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.040791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:14.042135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:14.042590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.120339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:14.124559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:14.129873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a3d1505-02dc-4d70-b333-5a52a05bc092 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.190960 Sep 06 12:17:14.130661 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2126/4226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:14.135388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ed41799f-f82b-430c-83e4-0c9b3a4a6b46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '.version_select at 0x7f97f49a9d30>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:14.138945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-abdd58dc-a372-4f47-a306-da3f34138a56 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.114012 Sep 06 12:17:14.139655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2101/4227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:14.140563 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed41799f-f82b-430c-83e4-0c9b3a4a6b46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [c3da6d56-be45-4c72-a6e6-fcd188de5b4a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:17:14.176000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:14.176800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:14.185557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:14.185557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:14.185557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.185944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:14.186236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:14.186665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.268156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:14.276339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5c639de9-35fe-4e67-ac95-5296bb4194e5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1294 microversion: 2.1 time: 0.105562 Sep 06 12:17:14.277185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2102/4228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:14 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:14.592717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:14.593725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:14.602592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:14.603129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:14.603574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.604461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:14.604907 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:14.605364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:14.769778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:14.778922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-56a63755-7d4c-4181-8817-9d60e9185543 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.192402 Sep 06 12:17:14.779609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2103/4229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:14 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:15.150937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed41799f-f82b-430c-83e4-0c9b3a4a6b46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [c3da6d56-be45-4c72-a6e6-fcd188de5b4a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55104. Sep 06 12:17:15.155692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:15.156325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:15.164463 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.164967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.165439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.166190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.166652 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.167126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.177591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ed41799f-f82b-430c-83e4-0c9b3a4a6b46 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399595887" status: 204 len: 0 microversion: 2.20 time: 1.045751 Sep 06 12:17:15.180220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2127/4230] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Sep 6 12:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399595887 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 12:17:15.196704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:15.200952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:15.212603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.213129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.213574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.214323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.215298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.215298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.219751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:15.290972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:15.302727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8750a74f-edb0-4a9f-a76a-b104b34436ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.121155 Sep 06 12:17:15.303455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2128/4231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:15.308604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:15.309432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:15.318788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.319703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.320374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.321245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.322792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.323291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.400330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:15.410376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba67cb75-eba7-4586-ad2b-994f9418aa71 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.259280 Sep 06 12:17:15.411948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:15.422490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2104/4232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:15 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:15.437285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c80c228f-5272-4723-be95-a0df0f51b25f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1300 microversion: 2.1 time: 0.132483 Sep 06 12:17:15.438348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2129/4233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:15 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:15.806897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:15.807728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:15.814931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.815700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.816303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:15.817332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:15.817967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:15.818535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.094725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:16.104300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5f6fe0ac-615c-4ee6-9551-d8ea6f4fa662 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.304308 Sep 06 12:17:16.119816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2105/4234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:15 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:16.327698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:16.328984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:16.336156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.336885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.338728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.339536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.340073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.340770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.503436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:16.526030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5ebf7056-8d60-4b7b-ad90-1bc5ef784aa8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.201672 Sep 06 12:17:16.527769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2130/4235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:16.535027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:16.536243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:16.541397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-a8c085a9-93e7-4565-b682-6f06e4173266 req-5b10f874-4783-4ea1-903c-6ecaa3f45d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:16.552275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.553028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.554127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.554841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.555863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.557106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.587716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a8c085a9-93e7-4565-b682-6f06e4173266 req-5b10f874-4783-4ea1-903c-6ecaa3f45d34 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.588312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a8c085a9-93e7-4565-b682-6f06e4173266 req-5b10f874-4783-4ea1-903c-6ecaa3f45d34 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.601243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-a8c085a9-93e7-4565-b682-6f06e4173266 req-5b10f874-4783-4ea1-903c-6ecaa3f45d34 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.632564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-a8c085a9-93e7-4565-b682-6f06e4173266 req-5b10f874-4783-4ea1-903c-6ecaa3f45d34 service nova] Creating event network-changed:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 12:17:16.643060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-a8c085a9-93e7-4565-b682-6f06e4173266 req-5b10f874-4783-4ea1-903c-6ecaa3f45d34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242341 Sep 06 12:17:16.657827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2106/4236] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:16.667983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:16.668822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:16.683304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.683908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.684416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.685329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:16.686040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:16.686655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:16.739726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:16.987629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:16.998517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e2e22f7e-d04b-4d5c-87a7-5aacd83c531c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.338223 Sep 06 12:17:16.999438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2107/4237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:16 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:17.004989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-e22e7e52-9698-426c-a3d4-be1901e62451 req-ecc46a89-06ac-413e-a34b-fb5cbce887a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71ac230-7b8b-496d-951a-748db65f4839", "tag": "9720560a-3549-45ec-b606-0f6722934e0a"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:17.016429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-e22e7e52-9698-426c-a3d4-be1901e62451 req-ecc46a89-06ac-413e-a34b-fb5cbce887a0 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:17.016919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-e22e7e52-9698-426c-a3d4-be1901e62451 req-ecc46a89-06ac-413e-a34b-fb5cbce887a0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:17.017360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-e22e7e52-9698-426c-a3d4-be1901e62451 req-ecc46a89-06ac-413e-a34b-fb5cbce887a0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:17.031735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-e22e7e52-9698-426c-a3d4-be1901e62451 req-ecc46a89-06ac-413e-a34b-fb5cbce887a0 service nova] Creating event network-changed:9720560a-3549-45ec-b606-0f6722934e0a for instance e71ac230-7b8b-496d-951a-748db65f4839 on hv-cinder-85604 Sep 06 12:17:17.037758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-e22e7e52-9698-426c-a3d4-be1901e62451 req-ecc46a89-06ac-413e-a34b-fb5cbce887a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036852 Sep 06 12:17:17.038547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2108/4238] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:17.043942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f823c490-a823-45b7-8edd-d174b4bb4a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'create', calling method: .version_select at 0x7f97f5190280>, body: {"keypair": {"name": "tempest-keypair-665078048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf+RiQSen+WLuJ46bAP9BOtYOISkDyE34WdNO8KPboqKaJeR18LdOvi7NpyKry/7lv3N2AHQ4mp5UB8vd2HTZdMiMWkrR6+0gqfYRvu6ywiyjMD7eg8ONSq0jZYWu25qg=="}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:17.062757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-f823c490-a823-45b7-8edd-d174b4bb4a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for project a896d72b5b00477d855131345711c748. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:17:17.067431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-f823c490-a823-45b7-8edd-d174b4bb4a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for user e235718ad1da42ebb209fb4b13626ff1 and project a896d72b5b00477d855131345711c748. Resources: {'key_pairs'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:17:17.099841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f823c490-a823-45b7-8edd-d174b4bb4a5a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059898 Sep 06 12:17:17.100865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2109/4239] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Sep 6 12:17:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 12:17:17.135380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:17.138308 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] [instance: 3c25daad-79a8-415a-bfb0-7678bbfe0ef2] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:17.156301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:17.157277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:17.158891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:17.159858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:17.160500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:17.160982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:17.176303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:17.184752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-576d06a7-2b63-45bd-a63f-3e55f9af13cd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.655615 Sep 06 12:17:17.185343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2131/4240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:17.472710 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683b8a5c6d9048fe871fc563c9e45ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474249b02d3140b6bae6ec312cdd142f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:17.495913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-118f1e63-3d7e-45ac-854c-5e4769a6f2cc tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2" status: 200 len: 1600 microversion: 2.1 time: 0.366920 Sep 06 12:17:17.496820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2110/4241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:17 2022] GET /compute/v2.1/servers/3c25daad-79a8-415a-bfb0-7678bbfe0ef2 => generated 1600 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:17.524192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-de5c14f7-9b16-4618-9ff2-9ab1e9a7e027 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] Calling method '.version_select at 0x7f97f85c30d0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:17.554139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-de5c14f7-9b16-4618-9ff2-9ab1e9a7e027 tempest-TestMinimumBasicScenario-1735965693 tempest-TestMinimumBasicScenario-1735965693-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1056706380" status: 202 len: 0 microversion: 2.1 time: 0.034709 Sep 06 12:17:17.554740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2132/4242] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Sep 6 12:17:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1056706380 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:17:17.573321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:17.574647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:17.582276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:17.582878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:17.583205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:17.584041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:17.585429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:17.586122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:17.692363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:17.715000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-26aedf40-0bf3-41f1-8b8d-6efb4fde9d2d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.148185 Sep 06 12:17:17.716534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2111/4243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:18.020369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:18.020981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:18.027881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:18.028643 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:18.029171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:18.029996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:18.030569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:18.031104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:18.179476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:18.187847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f9325b88-524f-4982-b378-b902f9defa7c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.171308 Sep 06 12:17:18.188758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2133/4244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:18 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:18.215255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:18.216532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:18.227690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:18.228207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:18.228625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:18.229327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:18.229812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:18.230244 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:18.422666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:18.431464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-25aaac83-86c3-4130-b300-b3bf17d4165c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.222382 Sep 06 12:17:18.432063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2112/4245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:18.750351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:18.750966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:18.759199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:18.759697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:18.760190 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:18.760889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:18.761361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:18.761805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:18.832207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:18.841829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e57a97d-e85a-41e3-939a-6d698040c9c2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095333 Sep 06 12:17:18.842464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2134/4246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:19.217680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:19.218320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:19.224521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:19.225103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:19.225704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:19.226428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:19.226576 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-258662489", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d9784aa-9738-4bb2-80bc-2db45f4fdf93"}], "security_groups": [{"name": "tempest-securitygroup--270402613"}], "key_name": "tempest-keypair-665078048", "user_data": "}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:19.227223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:19.227779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:19.400912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] validate_networks() for [('2d9784aa-9738-4bb2-80bc-2db45f4fdf93', None, None, None, None, None)] {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:17:19.405012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:19.414672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-314ce208-306c-40f6-9842-b53a47c8a0be tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.200804 Sep 06 12:17:19.415272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2113/4247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:19 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:19.455744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:19.456360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:19.463578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:19.464098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:19.464548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:19.465260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:19.465756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:19.466188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:19.603172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:19.613215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cf79b8be-6c18-4319-a67b-0ef5cbc940c2 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161332 Sep 06 12:17:19.613742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2114/4248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:19.867342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:19.867987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:19.875927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:19.876467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:19.876912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:19.877627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:19.878112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:19.878538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:19.979063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:19.990779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4c82d4e-6e79-4815-970f-4b3ae8538314 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.128395 Sep 06 12:17:19.992488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2115/4249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:20.097358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:17:20.097981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:17:20.098744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:17:20.099444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:17:20.100664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:17:20.111289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:20.112458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:20.112913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:20.113681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:20.114171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:20.114810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:20.135173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for project a896d72b5b00477d855131345711c748. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:17:20.139641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Getting quotas for user e235718ad1da42ebb209fb4b13626ff1 and project a896d72b5b00477d855131345711c748. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:17:20.155367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:17:20.158159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:17:20.222183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dae26218-a415-4cc6-9fe3-06a707989639 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.000864 Sep 06 12:17:20.226247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2135/4250] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Sep 6 12:17:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 12:17:20.247371 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-71cce88b-0209-46ab-8a21-cfe9af8c08cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:20.251500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-71cce88b-0209-46ab-8a21-cfe9af8c08cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:20.344312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-71cce88b-0209-46ab-8a21-cfe9af8c08cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:20.356331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-71cce88b-0209-46ab-8a21-cfe9af8c08cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:20.362909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-71cce88b-0209-46ab-8a21-cfe9af8c08cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:20.364174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-71cce88b-0209-46ab-8a21-cfe9af8c08cb tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1280 microversion: 2.20 time: 0.128096 Sep 06 12:17:20.364771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2116/4251] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:20 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:20.442348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:20.443261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:20.453605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:20.455095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:20.455781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:20.456859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:20.457520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:20.458159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:20.636876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:20.637844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:20.646320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:20.648128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:20.648815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:20.649868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:20.650549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:20.651076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:20.740205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:20.753715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2bb427db-1225-43f3-8c50-bc8557850878 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.318714 Sep 06 12:17:20.754327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2136/4252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:20 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:20.814883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:20.824248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-88c5f1ed-4b17-4e75-8480-22ef8dc2f4d6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.191299 Sep 06 12:17:20.824808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2117/4253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:21.020460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:21.021084 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:21.028609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.029342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.029951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.030806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.031411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.031981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.133803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:21.144419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fb6b04e6-ee06-426e-a76d-5aee135f1b6b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.127871 Sep 06 12:17:21.145157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2137/4254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:21.390406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:21.391020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:21.394531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:17:21.394860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:17:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 (ip 10.222.0.18) !!! Sep 06 12:17:21.404131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.404906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.405569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.406982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.407636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.408265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.490357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:21.500945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:21.502569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:21.503704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7ef4a1ed-ad0f-44aa-bb09-b5db7c08e3af tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1332 microversion: 2.20 time: 0.117234 Sep 06 12:17:21.504272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2118/4255] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:21 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:21.780453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:21.780950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:21.789676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.790436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.791393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.792706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.793182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.796128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.863762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:21.864398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:21.875434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.875926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.878313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:21.879121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:21.882757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:21.883250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:22.033706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:22.044253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b1003d9b-e51c-4fd4-b4f4-e6071bbc8162 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.269305 Sep 06 12:17:22.044900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2138/4256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:21 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:22.169194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:22.169803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:22.176089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:22.176578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:22.177023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:22.177759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:22.178221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:22.178926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:22.238231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:22.249559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bb16ea1d-3ad1-4266-bc11-db19315c496b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.400397 Sep 06 12:17:22.250325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2119/4257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:21 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:22.250803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:22.261814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1394f030-c024-4c04-a8eb-886658e3c162 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.096366 Sep 06 12:17:22.277955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2139/4258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:22.532757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:22.533372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:22.542117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:22.542599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:22.543033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:22.543762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:22.544214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:22.544627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:22.629418 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:22.640184 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:22.644086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:22.645548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-893dfd62-1ef1-411f-99ea-d9fa2577a28d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1338 microversion: 2.20 time: 0.120023 Sep 06 12:17:22.646540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2120/4259] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:22 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1338 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:23.068687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:23.069667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:23.079206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.082128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.082585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.083320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.083776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.084263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.275965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:23.277068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:23.288980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:23.294993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.295577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.296571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.297711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.298455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.299280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.300302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a7c76560-e862-43ed-8ebd-e28b51a03f07 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.235391 Sep 06 12:17:23.305038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2140/4260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:23 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:23.320502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:23.321493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:23.328353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.329010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.329542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.330440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.331097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.331850 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.414219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:23.423762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-247d5b99-a19b-4137-804d-1aaa1347af35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.119711 Sep 06 12:17:23.424366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2141/4261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:23.582021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:23.594965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-582238f3-4fc5-4bde-b2e5-dcdbadc5f63f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.323939 Sep 06 12:17:23.595862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2121/4262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:23.675870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:23.676494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:23.685697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.685697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.685941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.688822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:23.688822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:23.688822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:23.987909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:24.004528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:24.006085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:24.007373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1467593c-7e15-4e2e-b92e-a116d7a18868 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.335267 Sep 06 12:17:24.009232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2142/4263] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:23 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:24.123137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-9eb71560-c30c-43ba-9d4a-ab35a06b5597 req-a3268fb6-1b73-4015-ac8d-cc10d995a6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3e3706-8f24-400d-889c-3cd946e70e71", "tag": "2dd592a8-e422-4f7e-8c4d-81308f6c2b0f"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:24.135808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-9eb71560-c30c-43ba-9d4a-ab35a06b5597 req-a3268fb6-1b73-4015-ac8d-cc10d995a6ff service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.136291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-9eb71560-c30c-43ba-9d4a-ab35a06b5597 req-a3268fb6-1b73-4015-ac8d-cc10d995a6ff service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.136728 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-9eb71560-c30c-43ba-9d4a-ab35a06b5597 req-a3268fb6-1b73-4015-ac8d-cc10d995a6ff service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.150655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-9eb71560-c30c-43ba-9d4a-ab35a06b5597 req-a3268fb6-1b73-4015-ac8d-cc10d995a6ff service nova] Creating event network-changed:2dd592a8-e422-4f7e-8c4d-81308f6c2b0f for instance 1f3e3706-8f24-400d-889c-3cd946e70e71 on hv-cinder-85604 Sep 06 12:17:24.156932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-9eb71560-c30c-43ba-9d4a-ab35a06b5597 req-a3268fb6-1b73-4015-ac8d-cc10d995a6ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037418 Sep 06 12:17:24.157821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2122/4264] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:24.324456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:24.325077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:24.331760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.332219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.332647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.333365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.333859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.334791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.450694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:24.451720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:24.458638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.459986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.460713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.461544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.462272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.462812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.480540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:24.489679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-780799d0-887e-44e5-90c8-32245ca2e709 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.168917 Sep 06 12:17:24.501810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2143/4265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:24 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:24.568140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:24.577140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a8624f8-3f0d-41d2-a589-3b0ef8825d77 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.131802 Sep 06 12:17:24.577961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2123/4266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:24.620389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:24.621040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:24.627674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.628264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.628733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.630005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:24.630276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:24.630619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:24.845599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:24.857068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ddb3aa0-c40a-4617-8796-49618b8a6470 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.240912 Sep 06 12:17:24.857792 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2144/4267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:25.034333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:25.035159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:25.043458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.044136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.044680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.045521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.046156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.046722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.480185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:25.489105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:25.490631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:25.491838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0ca593dd-df76-4d60-b4cc-02af3b81af8a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.461962 Sep 06 12:17:25.492569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2124/4268] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:25 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:25.514285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:25.515695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:25.525891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.527317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.527966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.529089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.529782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.531180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.577805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-cf244ee1-4654-4ddb-87b6-72e9013cd673 req-52f2d391-78af-4702-b006-d941bfc805a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71ac230-7b8b-496d-951a-748db65f4839", "name": "network-vif-plugged", "status": "completed", "tag": "9720560a-3549-45ec-b606-0f6722934e0a"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:25.591645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-cf244ee1-4654-4ddb-87b6-72e9013cd673 req-52f2d391-78af-4702-b006-d941bfc805a5 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.592141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-cf244ee1-4654-4ddb-87b6-72e9013cd673 req-52f2d391-78af-4702-b006-d941bfc805a5 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.592578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-cf244ee1-4654-4ddb-87b6-72e9013cd673 req-52f2d391-78af-4702-b006-d941bfc805a5 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.606865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-cf244ee1-4654-4ddb-87b6-72e9013cd673 req-52f2d391-78af-4702-b006-d941bfc805a5 service nova] Creating event network-vif-plugged:9720560a-3549-45ec-b606-0f6722934e0a for instance e71ac230-7b8b-496d-951a-748db65f4839 on hv-cinder-85604 Sep 06 12:17:25.612137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-cf244ee1-4654-4ddb-87b6-72e9013cd673 req-52f2d391-78af-4702-b006-d941bfc805a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225551 Sep 06 12:17:25.612747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2145/4269] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:25.618585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:25.619297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:25.626599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.626990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.627616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.628360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.629002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.629438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.723327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:25.734473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-edf6fd47-7763-4c03-a71a-8f8a572b9fde tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.120023 Sep 06 12:17:25.735399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2146/4270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:25.794390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:25.807835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d285eb6a-19a0-4466-84fe-96aaca763a11 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.298137 Sep 06 12:17:25.808473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2125/4271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:25 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:25.883567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:25.885580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:25.894565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.895103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.895484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.896187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:25.900009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:25.900440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:25.905548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:26.102636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:26.120764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-46131a0b-a8b8-4ec2-87fb-8d3be734f6bb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.241070 Sep 06 12:17:26.125747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2147/4272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:26.518195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:26.519417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:26.527801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:26.528445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:26.529106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:26.530131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:26.530695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:26.531678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:26.742124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:26.750522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:26.751975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:26.753915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e5a3e21-44e9-49e2-92f9-aebb8109ad5c tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.238988 Sep 06 12:17:26.759708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:26.760315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:26.765785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2126/4273] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:26 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:26.769992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:26.770863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:26.772217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:26.773500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:26.774374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:26.774807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:26.837227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:26.838947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:26.852072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:26.852810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:26.852944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:26.853606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:26.854706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:26.855363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:26.856396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:26.863496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-59986a17-7475-4128-bbf5-e39d8c930411 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.106485 Sep 06 12:17:26.875397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:26.879156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2148/4274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:27.063696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:27.081158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f7714c06-329b-415f-948e-c08016b6b353 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.248288 Sep 06 12:17:27.082278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2127/4275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:26 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:27.144567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:27.145481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:27.152881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:27.153882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:27.154549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:27.155545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:27.156268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:27.156912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:27.414248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:27.422978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b03c3331-ff74-4563-ac29-5bd23ed53382 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.282304 Sep 06 12:17:27.434197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2149/4276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:27.781705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:27.783073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:27.790888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:27.791758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:27.792347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:27.793210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:27.793880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:27.794448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:27.888957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:27.889595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:27.899414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:27.906633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:27.907107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:27.907871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:27.908303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:27.908731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:27.988966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:28.000996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:28.001512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:28.003432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:28.004909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-93cf3278-25b2-43cc-a84b-748d0769022b tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.228326 Sep 06 12:17:28.006614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2128/4277] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:27 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:28.012350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4f1cace2-3522-4bbb-8f3e-fefe30725560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.127386 Sep 06 12:17:28.013867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2150/4278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:28.109893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:28.111503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:28.126247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:28.127614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:28.128732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:28.130444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:28.132540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:28.133693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:28.331679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:28.341552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f80badaa-11f2-4b37-8473-3b30dc0b0414 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1368 microversion: 2.1 time: 0.239038 Sep 06 12:17:28.351906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2129/4279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:28 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:28.457410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:28.458822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:28.467015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:28.467983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:28.469056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:28.470583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:28.471417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:28.472095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:28.713562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:28.726377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7027202a-6154-42ab-98a7-8b4f2b79e2ce tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.272836 Sep 06 12:17:28.727478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2151/4280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:28 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:29.031646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:29.033062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:29.041774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:29.051667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.052515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.053352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.054314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.054939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.055528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.058239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:29.058869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:29.069712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.070210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.070647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.071356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.071814 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.072239 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.283993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:29.297816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8a5ca13a-04c4-4a7a-a444-c2e78b2a8b85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.248693 Sep 06 12:17:29.299573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2152/4281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:29.313829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:29.327323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:29.328894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:29.330069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1d017f58-7e99-4c00-a4df-b353e579cdb5 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.302354 Sep 06 12:17:29.337707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2130/4282] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:29 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:29.380820 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:29.382560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:29.394241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.395139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.395950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.397885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.399002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.399795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.593351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:29.603856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-80777a16-a2e7-4152-a454-4fae12a422b1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1558 microversion: 2.1 time: 0.238240 Sep 06 12:17:29.605240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2153/4283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:29 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:29.627518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:29.628022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:29.636124 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.641182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.641182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.641182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.641182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.642123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.752120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:29.753022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:29.773347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.774093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.774408 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e703a347-f0a7-4e44-b569-6d4b28f0822d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150865 Sep 06 12:17:29.774901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:29.776248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2131/4284] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 12:17:29 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:29.777549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:29.778270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:29.778906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:30.124526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:30.150817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=12 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:30.170205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:30.180350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c6fff63-e5d6-4abf-8019-ab38bf31cb24 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.431799 Sep 06 12:17:30.181138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2154/4285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:30.323785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:30.324413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:30.331820 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:30.332425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:30.332945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:30.335208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:30.336465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:30.337060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:30.357693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:30.358410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:30.366506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=12 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:30.369061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:30.369566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:30.370136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:30.370855 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:30.371352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:30.371799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:30.456443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:30.483149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d44d0bea-5d4d-4021-a486-7d40aae9e29b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.163472 Sep 06 12:17:30.484743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2132/4286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:30.975537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:30.988642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:30.992548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:30.994307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-333fd5c6-ac12-4dbb-82c0-dd3f1f71e44a tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.642218 Sep 06 12:17:30.995099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2155/4287] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:30 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:31.208865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:31.214213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:31.235625 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:31.236438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:31.237083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:31.238012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:31.238633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:31.247028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:31.532526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:31.533427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:31.543900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:31.549686 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:31.550340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:31.551196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:31.551746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:31.552303 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:31.679497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:31.705499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bc948148-4f4c-45a6-b1ec-78235c2a3b5c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.176805 Sep 06 12:17:31.718752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2156/4288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:31.732296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-267a3fb7-f023-4bda-a1fa-9bef66c432e1 req-021e0340-4842-4f91-9857-c2c0df3230c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3e3706-8f24-400d-889c-3cd946e70e71", "name": "network-vif-plugged", "status": "completed", "tag": "2dd592a8-e422-4f7e-8c4d-81308f6c2b0f"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:31.743835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-267a3fb7-f023-4bda-a1fa-9bef66c432e1 req-021e0340-4842-4f91-9857-c2c0df3230c8 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:31.744530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-267a3fb7-f023-4bda-a1fa-9bef66c432e1 req-021e0340-4842-4f91-9857-c2c0df3230c8 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:31.745129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-267a3fb7-f023-4bda-a1fa-9bef66c432e1 req-021e0340-4842-4f91-9857-c2c0df3230c8 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:31.761793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-267a3fb7-f023-4bda-a1fa-9bef66c432e1 req-021e0340-4842-4f91-9857-c2c0df3230c8 service nova] Creating event network-vif-plugged:2dd592a8-e422-4f7e-8c4d-81308f6c2b0f for instance 1f3e3706-8f24-400d-889c-3cd946e70e71 on hv-cinder-85604 Sep 06 12:17:31.768770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-267a3fb7-f023-4bda-a1fa-9bef66c432e1 req-021e0340-4842-4f91-9857-c2c0df3230c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047857 Sep 06 12:17:31.770258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2157/4289] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:31.780543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-5ac4928a-b958-4540-b023-de32e2ba1164 req-8c9e8cb0-2f45-4d0d-9f5b-e4ef9bee407b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71ac230-7b8b-496d-951a-748db65f4839", "tag": "9720560a-3549-45ec-b606-0f6722934e0a"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:31.795215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:31.798378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5ac4928a-b958-4540-b023-de32e2ba1164 req-8c9e8cb0-2f45-4d0d-9f5b-e4ef9bee407b service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:31.799091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5ac4928a-b958-4540-b023-de32e2ba1164 req-8c9e8cb0-2f45-4d0d-9f5b-e4ef9bee407b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:31.799808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5ac4928a-b958-4540-b023-de32e2ba1164 req-8c9e8cb0-2f45-4d0d-9f5b-e4ef9bee407b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:31.848599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-5ac4928a-b958-4540-b023-de32e2ba1164 req-8c9e8cb0-2f45-4d0d-9f5b-e4ef9bee407b service nova] Creating event network-changed:9720560a-3549-45ec-b606-0f6722934e0a for instance e71ac230-7b8b-496d-951a-748db65f4839 on hv-cinder-85604 Sep 06 12:17:31.856289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-5ac4928a-b958-4540-b023-de32e2ba1164 req-8c9e8cb0-2f45-4d0d-9f5b-e4ef9bee407b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082069 Sep 06 12:17:31.857818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2158/4290] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:31.880799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:31.909567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1ed22476-97c5-4e8b-9931-96c13d68f4d3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.708570 Sep 06 12:17:31.917518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2133/4291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:32.025316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:32.026713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:32.079706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:32.081275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:32.081744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:32.085833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:32.087136 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:32.087739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:32.341355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:32.352509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:32.354741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:32.357108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c8064747-8985-4c68-af4e-d889d8925e55 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.336131 Sep 06 12:17:32.374420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2159/4292] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:32 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:32.735262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:32.735888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:32.744936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:32.745705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:32.746300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:32.747143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:32.747739 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:32.748422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:32.913163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:32.922305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-32aa2b02-b498-4162-b12a-2a76ecfd3dc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.191033 Sep 06 12:17:32.925682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2134/4293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:32.945277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:32.946810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:32.954250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:32.955152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:32.955939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:32.957083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:32.958003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:32.958719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:33.211924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:33.223360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-686ad787-4bc4-4b66-ba13-3d54125043c1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.282481 Sep 06 12:17:33.234583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2160/4294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:33.385961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:33.386589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:33.399572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:33.402823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:33.403636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:33.404535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:33.405145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:33.406427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:33.746433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:33.762669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:33.765829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:33.767223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c01430c8-e548-4eca-9e6f-a0199e2a3f3e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1405 microversion: 2.20 time: 0.389106 Sep 06 12:17:33.786158 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2135/4295] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:33 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:33.948566 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:33.949193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:33.960939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:33.961363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:33.961842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:33.962586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:33.963059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:33.963493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:34.138548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:34.162363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bca621f8-ff9e-47f8-a621-040269324202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.217187 Sep 06 12:17:34.179197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2161/4296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:34.254478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:34.255640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:34.275445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:34.276204 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:34.276806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:34.277985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:34.279485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:34.280105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:34.796862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:34.797806 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:34.812817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:34.820987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:34.821821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:34.822759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:34.823197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:34.825914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:34.826515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:34.840612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7141d71d-e057-4b5c-8600-1e3f9cbb725e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.596009 Sep 06 12:17:34.853493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2136/4297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:35.086398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:35.100595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:35.110403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:35.111512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fab09da3-9cbf-4a65-8f3d-b2a730c44f4d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1597 microversion: 2.20 time: 0.319050 Sep 06 12:17:35.112280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2162/4298] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:17:34 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1597 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:17:35.149438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:35.152927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:35.180614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:35.189431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:35.190181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:35.193772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:35.199219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:35.199712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:35.200691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:35.202565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:35.203193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:35.204266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:35.212519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:35.213610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:35.214296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:35.214914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:35.367639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:35.381395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c14a4423-9bcc-4474-906a-788b24154dae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.194327 Sep 06 12:17:35.403602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b8a0d02e-1664-480b-97f3-806e4503c97d tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.264176 Sep 06 12:17:35.413933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2137/4299] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Sep 6 12:17:35 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 12:17:35.414383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2163/4300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:35.868376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:35.869562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:35.883078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:35.883568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:35.884002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:35.884716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:35.885273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:35.885588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:36.408900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:36.410994 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:36.418409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:36.419343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:36.419971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:36.421063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:36.421863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:36.422485 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:36.482368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:36.500923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-124b12af-3b5b-4a85-b1a0-7202ddcef4ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.637223 Sep 06 12:17:36.501604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2138/4301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:35 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:36.541370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:36.561097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-639e3c01-92b4-4094-9033-daf53969e94e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.155978 Sep 06 12:17:36.561731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2164/4302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:36.886741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-4bdfa996-c6ec-4755-9c42-d12d64037d41 req-2af68a83-12d7-4fbd-b6c2-9345974dc979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3e3706-8f24-400d-889c-3cd946e70e71", "tag": "2dd592a8-e422-4f7e-8c4d-81308f6c2b0f"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:36.902880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-4bdfa996-c6ec-4755-9c42-d12d64037d41 req-2af68a83-12d7-4fbd-b6c2-9345974dc979 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:36.903361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-4bdfa996-c6ec-4755-9c42-d12d64037d41 req-2af68a83-12d7-4fbd-b6c2-9345974dc979 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:36.903790 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-4bdfa996-c6ec-4755-9c42-d12d64037d41 req-2af68a83-12d7-4fbd-b6c2-9345974dc979 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:36.929706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-4bdfa996-c6ec-4755-9c42-d12d64037d41 req-2af68a83-12d7-4fbd-b6c2-9345974dc979 service nova] Creating event network-changed:2dd592a8-e422-4f7e-8c4d-81308f6c2b0f for instance 1f3e3706-8f24-400d-889c-3cd946e70e71 on hv-cinder-85604 Sep 06 12:17:36.935050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-4bdfa996-c6ec-4755-9c42-d12d64037d41 req-2af68a83-12d7-4fbd-b6c2-9345974dc979 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052132 Sep 06 12:17:36.936246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2139/4303] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:37.525264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:37.526136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:37.532663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:37.533484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:37.534173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:37.535086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:37.535804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:37.536446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:37.665343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27eaf37d-ee87-4add-8541-96240bf29952 tempest-TestVolumeBootPattern-1338939541 tempest-TestVolumeBootPattern-1338939541-project] Action: 'create', calling method: .version_select at 0x7f97f4a05af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2126059385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRTFss9AAv5x21uXiw7hnfgUveS/xNZJ+7YbTe16qa/fSrlUhZDrgoh2qan25E1jeBQMWmDH/mJVmwPQXwa0aCqUCeulYAHuEKUHgF/g+CYd1+sIuRpQrXkegHDeR3ww=="}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:17:37.712472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:37.713284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-27eaf37d-ee87-4add-8541-96240bf29952 tempest-TestVolumeBootPattern-1338939541 tempest-TestVolumeBootPattern-1338939541-project] Getting quotas for project 2006ceb6c9d641019ec86aea7e4b676f. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:17:37.723501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-27eaf37d-ee87-4add-8541-96240bf29952 tempest-TestVolumeBootPattern-1338939541 tempest-TestVolumeBootPattern-1338939541-project] Getting quotas for user 6d920e2427d145feb7ae253d5eda28b7 and project 2006ceb6c9d641019ec86aea7e4b676f. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:17:37.728009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4319c63c-f12d-4be7-91b1-1c1fc831337e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.207375 Sep 06 12:17:37.728615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2140/4304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:37.734019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:37.734802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:37.745077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:37.745950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:37.746605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:37.747541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:37.748945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:37.749582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:37.811755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27eaf37d-ee87-4add-8541-96240bf29952 tempest-TestVolumeBootPattern-1338939541 tempest-TestVolumeBootPattern-1338939541-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.365149 Sep 06 12:17:37.814398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2165/4305] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 12:17:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:17:37.842171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:37.852857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb5e6bf1-478a-4c56-9c43-4a3862584e21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.123007 Sep 06 12:17:37.853480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2141/4306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:38.757978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:38.758833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:38.769432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:38.770101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:38.770824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:38.772130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:38.772982 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:38.773778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:38.778225 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:38.876402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:38.876936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:38.884499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:38.885063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:38.885503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:38.886240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:38.887138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:38.887651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:38.960945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:38.969852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ed60ed54-86e6-471d-bad1-ce6c581065a1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097353 Sep 06 12:17:38.970599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2142/4307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:38.996642 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:39.005779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8a1a014a-8f98-41fb-ba3d-0c100a627c45 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.253724 Sep 06 12:17:39.006572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2166/4308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:39.997420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:39.998048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:40.004439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:40.004913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:40.005351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:40.006238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:40.007003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:40.007428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:40.030255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:40.030876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:40.038844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:40.039798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:40.040090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:40.041029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:40.041844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:40.042178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:40.078866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:40.088490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-586a751c-0c90-440e-9d42-3134075465c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.094942 Sep 06 12:17:40.089085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2143/4309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:40.205314 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:40.218355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-80c21908-b7ea-483e-8b2d-7f473477346f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.189433 Sep 06 12:17:40.218355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2167/4310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:40 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:41.112938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:41.113507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:41.120248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:41.120735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:41.121177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:41.121956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:41.122416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:41.122851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:41.192175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:41.201971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3eac5b95-9fad-4b54-9706-684e0bd89879 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093184 Sep 06 12:17:41.202672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2144/4311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:41.240817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:41.241456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:41.248551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:41.249054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:41.249547 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:41.250241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:41.250703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:41.251134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:41.412546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:41.423809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-09f314e1-0807-4424-855a-413fb640ef01 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.187308 Sep 06 12:17:41.424403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2168/4312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:42.228125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:42.228666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:42.236029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:42.236525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:42.236966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:42.237694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:42.238188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:42.238624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:42.254555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:42.306275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:42.314660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b0c97d6e-2d92-4fd9-a6ae-727f4fe92e1a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090944 Sep 06 12:17:42.315243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2145/4313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:42.447720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:42.448337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:42.455105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:42.455629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:42.456071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:42.456775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:42.457237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:42.457683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:42.594087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:42.603235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-162b4716-0fb9-413e-8c2a-cd187880355a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159409 Sep 06 12:17:42.603815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2169/4314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:43.339380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:43.340024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:43.346642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:43.347119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:43.347555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:43.348282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:43.348736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:43.349163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:43.422810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:43.432092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bee8acc9-37af-4283-8ca4-c19642b7220c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097254 Sep 06 12:17:43.432677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2146/4315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:43.626839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:43.627470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:43.634655 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:43.635198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:43.635679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:43.636420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:43.636885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:43.637315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:43.787781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:43.796311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-441d76b8-4270-4c14-9308-866b027356ea tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.173382 Sep 06 12:17:43.796891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2170/4316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:44.456027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:44.456649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:44.463352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:44.463836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:44.464277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:44.464973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:44.465430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:44.465895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:44.530947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:44.540598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aac349f5-a325-417d-aefe-bc12cea93ee6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088378 Sep 06 12:17:44.541179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2147/4317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:44.824936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:44.825491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:44.832090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:44.832578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:44.833011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:44.834254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:44.835297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:44.835727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:44.974005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:44.982316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-df0e1c6a-54eb-4fc6-ad4f-775a2c1a9144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161314 Sep 06 12:17:44.982903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2171/4318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:45.563478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:45.564096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:45.572036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:45.572531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:45.572961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:45.573675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:45.574202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:45.574624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:45.641426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:45.649956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc3b086e-a818-4a81-89b6-043a02afeedc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090237 Sep 06 12:17:45.650542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2148/4319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:46.006188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:46.006840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:46.013280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:46.013861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:46.014306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:46.015012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:46.015474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:46.015896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:46.159499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:46.168269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-341de157-1efe-4713-9c98-9bdafe3981ad tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166532 Sep 06 12:17:46.168858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2172/4320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:46.673034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:46.673668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:46.681109 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:46.681609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:46.682072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:46.682781 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:46.683240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:46.683676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:46.757440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:46.767476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d358e938-59eb-4b5f-b437-7e74ebfa0d6c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.098481 Sep 06 12:17:46.768051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2149/4321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:47.199476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:47.200086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:47.206787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:47.207277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:47.207717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:47.208413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:47.209888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:47.210316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:47.342829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:47.351289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d60995e-b16b-49fc-b249-869aefefd107 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155621 Sep 06 12:17:47.351888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2173/4322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:47.792385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:47.792991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:47.799414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:47.799890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:47.800326 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:47.801007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:47.801454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:47.801902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:47.867708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:47.876010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2ec8e0b5-e9b1-4ad2-bcec-ead93b57203d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087428 Sep 06 12:17:47.876590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2150/4323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:48.374430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:48.374973 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:48.376760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:48.382502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:48.382988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:48.383422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:48.384114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:48.384561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:48.384974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:48.533507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:48.544638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b66ced32-4370-4b35-a7fe-ab2b68279640 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.173763 Sep 06 12:17:48.545323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2174/4324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:48.899944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:48.900552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:48.907534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:48.908014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:48.908443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:48.909126 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:48.909574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:48.910016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:48.976596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:48.984831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d8535046-fed6-4796-86f6-348668aee0b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089348 Sep 06 12:17:48.985398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2151/4325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:49.568711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:49.569230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:49.575819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:49.576340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:49.576781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:49.577476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:49.577963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:49.578391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:49.708657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:49.716922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c48794b-f7be-4651-9e8c-275f01d2dffb tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152306 Sep 06 12:17:49.717487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2175/4326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:49 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:50.012293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:50.013046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:50.019593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:50.020079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:50.020519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:50.021809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:50.022269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:50.022698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:50.092122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:50.101900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f945e9b7-1332-4a3d-871c-e8352fe7e3b6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097783 Sep 06 12:17:50.102898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2152/4327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:50.741171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:50.741818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:50.748509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:50.749000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:50.749441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:50.750169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:50.750633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:50.751063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:50.883296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:50.891902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d7f743cd-313b-49ef-b34f-43cc93f408a8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155088 Sep 06 12:17:50.892484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2176/4328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:50 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:51.125157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:51.125554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:51.132162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:51.132649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:51.133080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:51.133817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:51.134269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:51.134690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:51.201789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:51.210440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ebdb2ffe-1ec7-4993-b883-6cf71735b693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089845 Sep 06 12:17:51.211013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2153/4329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:52.013091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:52.013744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:52.019688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:52.020165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:52.020602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:52.021336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:52.021822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:52.022246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:52.160440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:52.169858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-89333d78-00cc-41c4-89b7-89dc7e2c72c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.258054 Sep 06 12:17:52.170437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2177/4330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:51 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:52.234199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:52.234746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:52.241955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:52.242432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:52.242862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:52.243553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:52.244001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:52.244423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:52.306069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:52.314207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a652a022-92c1-4273-9139-1c466d084c72 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084038 Sep 06 12:17:52.314776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2154/4331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:53.193307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:53.194268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:53.200517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:53.201014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:53.201450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:53.202185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:53.202645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:53.203077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:53.337180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:53.339345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:53.339966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:53.346602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:53.347097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:53.347538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:53.347816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f34fbf1-bb74-4ff6-b3ff-f0ca05494228 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158059 Sep 06 12:17:53.348243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:53.348669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2178/4332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:53 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:53.348853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:53.349187 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:53.415794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:53.424008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-617270bd-4718-4acf-87ee-35af466a953f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088515 Sep 06 12:17:53.424557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2155/4333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:54.376442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:54.377114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:54.387671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:54.388162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:54.388601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:54.389316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:54.389808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:54.390260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:54.447495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:54.448105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:54.455173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:54.455690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:54.456108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:54.456821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:54.457276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:54.457748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:54.524713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:54.535477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:54.538594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-75e178f4-76e2-48fc-a4fe-c63bb01c007a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.094962 Sep 06 12:17:54.539427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2156/4334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:54.546053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d2d9b0e1-371a-4461-a485-7888876b08e5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.176727 Sep 06 12:17:54.546796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2179/4335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:54 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:55.562577 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:55.563113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:55.570883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:55.571369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:55.571626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:55.572077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:55.572500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:55.572958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:55.573387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:55.574059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:55.580866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:55.581418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:55.581961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:55.582727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:55.583256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:55.584283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:55.648409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:55.657766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1c504951-08bf-4068-aa4d-1c7a9069edc4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.098984 Sep 06 12:17:55.658368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2157/4336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:55.735288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:55.744784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b816d079-c27f-4e95-a3ad-a2f66f5e53ae tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.177453 Sep 06 12:17:55.745371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2180/4337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:55 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:17:56.681248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:56.681895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:56.688462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:56.688967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:56.689403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:56.690145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:56.690609 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:56.691033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:56.755373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:56.763837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bfb58db3-2e59-4cef-9baf-8f8f18fa5259 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086593 Sep 06 12:17:56.764410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2158/4338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:56.769685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:56.771515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:56.778405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:56.778889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:56.779326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:56.780015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:56.780471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:56.780896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:56.914036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:56.923870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-406d38f8-3069-43ca-80e3-7f83d518883e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158127 Sep 06 12:17:56.924459 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2181/4339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:56 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:57.788324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:57.788944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:57.795596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:57.796081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:57.796520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:57.797219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:57.797695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:57.798123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:57.864939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:57.873412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-72dbbd20-2eeb-4ff7-8922-ea77cef5b568 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089585 Sep 06 12:17:57.874038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2159/4340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:57.948010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:57.948536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:57.955091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:57.955573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:57.956008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:57.956744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:57.957429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:57.958034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:58.357856 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:58.360096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:58.368299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a044a167-a8ad-4656-9dc5-983846983c69 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.424225 Sep 06 12:17:58.368878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2182/4341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:57 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:58.898727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:58.899336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:58.906219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:58.906717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:58.907159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:58.907864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:58.908321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:58.908752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:58.971237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:58.980855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8ead0aae-165b-4fc7-9c31-6620a1d50a27 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086493 Sep 06 12:17:58.981445 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2160/4342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:17:59.392125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:17:59.392767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:17:59.400389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:59.400874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:59.401308 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:59.402299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:17:59.402743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:17:59.403161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:17:59.545202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:17:59.554127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d10a9a31-c220-41f6-9ee3-422516a13f2e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.166032 Sep 06 12:17:59.554700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2183/4343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:59 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:00.003595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:00.004203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:00.006587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=62 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:00.013536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:00.014055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:00.014499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:00.015211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:00.015676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:00.016125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:00.081713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:00.090009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2ccaf84d-a663-42a9-8ef1-78800b2af9fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090238 Sep 06 12:18:00.090599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2161/4344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:17:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:00.578628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:00.579241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:00.586371 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:00.586860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:00.587300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:00.587998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:00.588457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:00.588886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:00.725222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:00.733490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-099bc974-749d-445e-9795-c6bb73aac842 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158770 Sep 06 12:18:00.734100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2184/4345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:00 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:01.116189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:01.116933 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:01.126472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:01.127314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:01.127973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:01.128948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:01.129817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:01.131207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:01.135180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:01.213083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:01.221522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d05b6a8-a9ba-47f3-819f-4fed5546388e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.111550 Sep 06 12:18:01.222133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2162/4346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:01.757572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:01.758260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:01.764975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:01.765468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:01.765945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:01.766652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:01.767115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:01.767546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:01.903965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:01.913454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-75e0d050-65f6-4e57-9a0c-bf780dde3545 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160348 Sep 06 12:18:01.914089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2185/4347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:01 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:02.245016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:02.245626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:02.252475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:02.253012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:02.253392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:02.254107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:02.254583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:02.255090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:02.322442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:02.331049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-86d5d0e0-e83a-4fa7-a8b1-6d4b4e6b8dbb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089498 Sep 06 12:18:02.331660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2163/4348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:02.937306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:02.937961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:02.940264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:02.946071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:02.946562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:02.947007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:02.947706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:02.948173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:02.948721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:03.090470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:03.099611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-992b2ab7-c2d1-4d6f-acc1-485add92ff65 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165550 Sep 06 12:18:03.100275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2186/4349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:02 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:03.354797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:03.355447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:03.362027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:03.362515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:03.362983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:03.363674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:03.364137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:03.364584 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:03.427691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:03.436136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-488d0601-990a-47c5-9628-6b8c78189d87 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085174 Sep 06 12:18:03.436752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2164/4350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:04.123766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:04.124351 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:04.131445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:04.131931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:04.132375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:04.133080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:04.133539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:04.134003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:04.273469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:04.282718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bdafa78e-9d31-4907-8a72-ed54dfe81ac5 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.162196 Sep 06 12:18:04.283810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2187/4351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:04 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:04.459873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:04.460499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:04.467302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:04.467822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:04.468261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:04.469002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:04.469460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:04.469926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:04.541934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:04.551243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-37b3cc9f-5bb5-4741-a565-f7a9a0258406 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095961 Sep 06 12:18:04.551901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2165/4352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:05.306949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:05.307570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:05.314157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:05.314645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:05.315089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:05.315778 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:05.316237 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:05.316664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:05.452534 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:05.461737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-448bf3b0-3832-414d-b910-fe7e8b57c029 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158619 Sep 06 12:18:05.462300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2188/4353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:05 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:05.576500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:05.577066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:05.583512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:05.584000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:05.584442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:05.585134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:05.585593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:05.586055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:05.647589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:05.656185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de22d720-e258-469d-8280-266f0c8213c5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083646 Sep 06 12:18:05.656761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2166/4354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:06.484797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:06.485414 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:06.491953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:06.492437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:06.492874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:06.493573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:06.494065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:06.494496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:06.627703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:06.637034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a0818a4f-f482-4f61-a38d-e4be7aa36d91 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156104 Sep 06 12:18:06.637629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2189/4355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:06 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:06.679424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:06.680041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:06.686533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:06.687023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:06.687456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:06.688150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:06.688613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:06.689040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:06.753944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:06.763016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ff0488a2-2885-4ae8-bd4a-92aa262783cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087629 Sep 06 12:18:06.763623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2167/4356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:07.662420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:07.663034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:07.669486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.670011 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.670454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.671150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.671607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.672034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.787317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:07.787883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:07.794508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.794986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.795415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.796103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:07.796549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:07.796974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:07.804557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:07.815608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ae434f6-f2ba-45dc-bedd-538917353e4d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157852 Sep 06 12:18:07.816206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2190/4357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:07 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:07.867596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:07.876294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-942528bd-ab84-44af-9237-a6374192af3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093464 Sep 06 12:18:07.876879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2168/4358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:08.839369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:08.839979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:08.847052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:08.847540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:08.847961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:08.849283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:08.849862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:08.850267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:08.901253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:08.902175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:08.909510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:08.910060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:08.910499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:08.911880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:08.912391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:08.912755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:08.984528 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:09.002335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-77d44aa1-add1-4e32-8ded-7e152c2ce16a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.104614 Sep 06 12:18:09.002961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2169/4359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:09.006967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:09.019150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-759391b6-1141-4ba8-b112-6ac937dc665d tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.183542 Sep 06 12:18:09.019835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2191/4360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:08 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:10.027565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:10.028195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:10.034708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.035192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.035619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.037036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.037516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.037979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.043554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:10.044176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:10.051122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.051634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.052219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.053213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:10.054066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:10.054664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:10.107579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:10.117250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7c98a8a8-bc1a-4ac7-8f51-063169ba9ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093709 Sep 06 12:18:10.117847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2170/4361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:10.354931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:10.363615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-64fa64a9-ce2f-40c1-9355-59a5e06ab417 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.323832 Sep 06 12:18:10.364256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2192/4362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:10 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:11.141227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:11.141821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:11.148968 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:11.149497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:11.149970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:11.150681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:11.151139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:11.151569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:11.221816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:11.231787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22a9e9a9-9c9a-4dc0-81c3-e9118193ff65 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.094460 Sep 06 12:18:11.232379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2171/4363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:11.387458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:11.388070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:11.394929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:11.395360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:11.396969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:11.398032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:11.398495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:11.398926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:11.543807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:11.552436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8e24b9d8-c94c-411b-a0d0-bbc9a362ccd8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.168722 Sep 06 12:18:11.553029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2193/4364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:11 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:12.256151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:12.256774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:12.263554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:12.264048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:12.264491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:12.265205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:12.265685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:12.266118 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:12.331665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:12.341756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ab706c7e-b156-4129-a50d-73f105d303fc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089853 Sep 06 12:18:12.350033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2172/4365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:12.576447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:12.577007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:12.584220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:12.584710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:12.585151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:12.585908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:12.586493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:12.586921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:12.715696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:12.723906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6bbbd141-85ae-46a4-a3c2-cebcbb710c1a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151432 Sep 06 12:18:12.724468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2194/4366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:12 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:13.367808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:13.368462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:13.375083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:13.375565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:13.376004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:13.376700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:13.377150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:13.377576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:13.444684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:13.453390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0d4acac9-0837-4ee0-a2c6-ec8a397a8ad8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091257 Sep 06 12:18:13.454015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2173/4367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:13.747115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:13.747731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:13.754238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:13.754836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:13.755257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:13.755949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:13.756408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:13.756833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:13.886536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:13.894721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f43cb5b8-5d3a-4cec-adc7-87edb403dfff tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.151448 Sep 06 12:18:13.895788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2195/4368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:13 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:14.477038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:14.477670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:14.484058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:14.484540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:14.484978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:14.485679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:14.486139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:14.486566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:14.555537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:14.564007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d6988232-da32-4144-9689-c036b3c29f73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090733 Sep 06 12:18:14.564601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2174/4369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:14.921065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:14.921703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:14.930244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:14.930719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:14.931150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:14.931858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:14.932300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:14.932715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:15.077380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:15.085972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-664c23b2-ec47-44cd-ad98-a063932f6bb1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.170058 Sep 06 12:18:15.086812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2196/4370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:14 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:15.589059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:15.589582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:15.596207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:15.596694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:15.597132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:15.597870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:15.599179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:15.599624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:15.665245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:15.673732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-305186ce-8a85-4850-b791-591acdf42a9e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088625 Sep 06 12:18:15.674306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2175/4371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:16.109194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:16.109866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:16.116912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:16.117396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:16.117877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:16.118571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:16.119029 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:16.119447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:16.260831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:16.269398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4e52b664-eae8-40a8-a432-488b48f65b26 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164044 Sep 06 12:18:16.270000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2197/4372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:16 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:16.696682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:16.697346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:16.703639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:16.704117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:16.704546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:16.705223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:16.705689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:16.706111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:16.767505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:16.776636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-52a1486e-7ec6-4d34-99e8-b74ead5b71e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083741 Sep 06 12:18:16.777477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2176/4373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:17.292865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:17.293480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:17.299935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:17.300420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:17.300860 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:17.302050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:17.302649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:17.303083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:17.440418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:17.449922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-514d47d6-1fd5-4173-a096-f3ef0c241a96 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160942 Sep 06 12:18:17.450506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2198/4374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:17 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:17.800427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:17.801058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:17.807854 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:17.808333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:17.808764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:17.809443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:17.809928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:17.810545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:17.876390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:17.886437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b79beb3a-4bf9-4a4e-80a9-c634c1c7af7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089753 Sep 06 12:18:17.887031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2177/4375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:18.475231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:18.475908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:18.482215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:18.482672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:18.483103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:18.483783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:18.484233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:18.484647 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:18.500323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:18.618496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:18.626776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a9bbce24-3e40-445b-87a6-670ead2fd244 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155559 Sep 06 12:18:18.627356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2199/4376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:18 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:18.910137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:18.911404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:18.918788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:18.919336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:18.919853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:18.920701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:18.921167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:18.921622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:18.987514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:18.990940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:18.998936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-50939481-723d-445e-ba54-e9ae81ad5766 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092601 Sep 06 12:18:18.999518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2178/4377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:19.651260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:19.651804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:19.658729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:19.659221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:19.659679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:19.660356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:19.660887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:19.661312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:19.791284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:19.799438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2cb98fcf-7601-4943-a383-c5be94f37f41 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.152205 Sep 06 12:18:19.800000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2200/4378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:19 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:20.022116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:20.022713 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:20.029379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:20.029903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:20.030351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:20.031043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:20.031504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:20.031937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:20.095732 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:20.104490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e8981547-4490-4639-b2a7-aa8991ea2d20 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086261 Sep 06 12:18:20.105064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2179/4379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:20.824623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:20.825218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:20.831700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:20.832183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:20.832623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:20.833479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:20.833970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:20.834400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:20.977574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:20.985992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6770815b-258e-4e21-bd42-5bc21cdcdd61 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.165312 Sep 06 12:18:20.986584 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2201/4380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:20 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:21.128513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:21.129058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:21.135576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:21.136072 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:21.136513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:21.137207 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:21.137684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:21.138115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:21.200840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:21.209531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-303f6e87-9591-4e94-bd0a-1f16dd89ad41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084945 Sep 06 12:18:21.210177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2180/4381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:22.010779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:22.011328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:22.017944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:22.018403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:22.018842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:22.019544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:22.020748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:22.020929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:22.155192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:22.164888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-06d743fc-6dc0-44ee-92bd-0823a1fccbde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.158027 Sep 06 12:18:22.165621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2202/4382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:22 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:22.234885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:22.235721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:22.243331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:22.243812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:22.244271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:22.244966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:22.245414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:22.245872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:22.323282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:22.331699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aa629041-0985-4785-8f08-f62923e0270d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.100626 Sep 06 12:18:22.332485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2181/4383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:23.190319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:23.190937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:23.198108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:23.198600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:23.199050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:23.199745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:23.200206 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:23.200639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:23.337679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:23.346183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab895f73-4ebf-412e-9a1a-8bba167502b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159709 Sep 06 12:18:23.346771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2203/4384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:23 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:23.356522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:23.357250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:23.364021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:23.364502 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:23.364934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:23.365624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:23.366101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:23.366524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:23.429279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:23.437614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b0f779b-453d-48b1-99a2-1d1fbe19cab9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084962 Sep 06 12:18:23.438236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2182/4385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:24.369067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:24.369804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:24.376252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:24.376734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:24.377166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:24.377977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:24.378424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:24.378843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:24.460755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:24.461383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:24.468366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:24.468863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:24.469305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:24.470061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:24.470711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:24.471150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:24.517372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:24.525769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8ce42e94-8a81-4455-8275-f90a5852644b tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161131 Sep 06 12:18:24.526514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2204/4386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:24 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:24.538113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:24.546576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa1c98c1-c348-4588-8cb3-1215b7458ecc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090025 Sep 06 12:18:24.547155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2183/4387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:25.548444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:25.549040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:25.556381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.556871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.557312 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.558043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.558505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.558932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.570567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:25.571205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:25.578332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.578834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.579335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.580059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:25.580635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:25.580947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:25.644149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:25.654309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d5ca9a33-93c3-4851-bc3e-9098873aa07d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087688 Sep 06 12:18:25.654896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2184/4388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:25.696670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:25.705176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-162dda70-bfde-4828-9401-0d9178fba055 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160471 Sep 06 12:18:25.705808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2205/4389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:25 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:26.678846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:26.679576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:26.686175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:26.686665 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:26.687107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:26.687810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:26.688269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:26.688701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:26.728802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:26.729549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:26.735965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:26.736451 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:26.736887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:26.737591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:26.738074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:26.738496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:26.756958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:26.766235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1216b190-50ad-46e7-aceb-4664b3c1dd6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091833 Sep 06 12:18:26.766838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2185/4390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:26.880521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:26.889307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9021cd3b-e1d6-4944-9966-7873d536ea8c tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164837 Sep 06 12:18:26.889943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2206/4391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:26 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:27.789588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:27.790240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:27.796902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:27.797383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:27.797858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:27.798569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:27.799017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:27.799436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:27.862295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:27.870565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e6503956-c653-46ea-a3b3-bfc4b5cdd547 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084857 Sep 06 12:18:27.871135 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2186/4392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:27.913034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:27.913775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:27.920357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:27.920849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:27.921291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:27.922036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:27.922498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:27.922928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:28.059116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:28.067646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9a5d2fb-41d2-4342-9ddb-10519a876c5e tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159207 Sep 06 12:18:28.068226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2207/4393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:27 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:28.893987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:28.894668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:28.901484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:28.902258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:28.902683 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:28.903365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:28.903810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:28.904229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:28.968611 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:28.977318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-40cc48e8-41d5-4154-8974-31c9c876144e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087168 Sep 06 12:18:28.977908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2187/4394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:29.091433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:29.092057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:29.098480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:29.098960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:29.099390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:29.100201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:29.100709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:29.101130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:29.233228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:29.241540 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d6252a4f-95c1-4cec-9a2a-3b09c5471fde tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.153941 Sep 06 12:18:29.242141 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2208/4395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:29 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:30.000633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:30.001161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:30.007678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:30.008170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:30.008616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:30.009305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:30.009792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:30.010218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:30.071593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:30.079825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-729944f7-98be-4de7-87a4-978979490a2b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083117 Sep 06 12:18:30.080423 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2188/4396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:30.264309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:30.264922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:30.271972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:30.272690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:30.273248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:30.274258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:30.274894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:30.275385 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:30.413145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:30.421904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36753d37-e7e4-4db3-ba94-f740053d6de8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.161372 Sep 06 12:18:30.422481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2209/4397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:30 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:31.102959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:31.103553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:31.105821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=56 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:31.110963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:31.111442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:31.111874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:31.112553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:31.112999 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:31.113416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:31.179588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:31.187908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4cac3b10-944a-4318-bbd8-d8febbb355cd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088794 Sep 06 12:18:31.188490 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2189/4398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:31.445866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:31.446475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:31.452889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:31.453369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:31.453837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:31.454520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:31.454971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:31.455390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:31.589177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:31.597381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0e57972f-3cc9-48c8-9436-b368f33a24ec tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.155567 Sep 06 12:18:31.597970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2210/4399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:31 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:32.212667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:32.213389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:32.223873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:32.224369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:32.225099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:32.225859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:32.226329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:32.226756 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:32.292402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:32.300672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-568e0c0b-e503-4be5-9df0-9bdaf63b9d1d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092665 Sep 06 12:18:32.301247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2190/4400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:32.621608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:32.622864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:32.629255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:32.629763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:32.630196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:32.631494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:32.631944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:32.632362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:32.763441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:32.771747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41faeb16-a0ab-471d-8b77-18e0454917f7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.154076 Sep 06 12:18:32.772318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2211/4401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:32 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:33.324515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:33.325385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:33.332548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:33.333274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:33.334511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:33.335598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:33.336314 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:33.336997 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:33.401284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:33.409760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c05876d0-4d06-45f5-a0b1-d69468cf71c3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089108 Sep 06 12:18:33.410339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2191/4402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:33.795261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:33.795890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:33.798274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=52 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:33.803500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:33.803991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:33.804430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:33.805131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:33.805589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:33.806050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:33.938335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:33.947520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4a291746-3d46-498e-a840-8c2733678bd3 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.156213 Sep 06 12:18:33.948094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2212/4403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:33 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:34.434255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:34.434855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:34.441466 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:34.441985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:34.442424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:34.443149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:34.444306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:34.444738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:34.511337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:34.519757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa043986-5eca-471d-8120-1c75af03d5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089300 Sep 06 12:18:34.520336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2192/4404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:34.971169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:34.971791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:34.979082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:34.979565 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:34.979998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:34.980688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:34.981139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:34.981562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.116295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:35.124713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-48e7fbf5-b0dd-4898-b0b1-4e8e04da58e1 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.157460 Sep 06 12:18:35.125286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2213/4405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:34 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:35.546686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:35.547297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:35.554347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:35.554831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:35.555271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.555971 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:35.556431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:35.556858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:35.626489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:35.635597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-25326d07-2bb9-47f0-9199-8e7efe582126 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092831 Sep 06 12:18:35.636192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2193/4406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:36.148471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:36.149056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:36.155812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:36.156300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:36.156731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:36.157415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:36.157896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:36.158343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:36.296358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:36.305028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34799821-1642-41ce-9a04-f5a0ee4eaf76 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160513 Sep 06 12:18:36.305608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2214/4407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:36 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:36.659201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:36.659806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:36.667203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:36.667680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:36.668123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:36.668810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:36.669264 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:36.669709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:36.732434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:36.741239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c6223800-9625-4c67-9dcd-2b6ab612c040 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085851 Sep 06 12:18:36.741856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2194/4408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:37.330392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:37.331007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:37.338137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:37.338625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:37.339064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:37.339765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:37.340219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:37.340640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:37.477833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:37.486076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d56a5eb5-7986-4ad0-8ab0-9247c255639f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.159536 Sep 06 12:18:37.486649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2215/4409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:37 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:37.764091 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:37.764792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:37.771857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:37.772469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:37.772909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:37.773605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:37.774156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:37.774583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:37.791655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:37.842208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:37.852258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d455b4f1-4934-4713-ac46-c954787fc264 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091909 Sep 06 12:18:37.852883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2195/4410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:38.511023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:38.511550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:38.517997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:38.518476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:38.518910 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:38.519596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:38.520046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:38.520464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:38.523863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:38.667222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:38.676730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eaf81c07-fb78-456c-8f58-262501f9e170 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.169558 Sep 06 12:18:38.677381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2216/4411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:38 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:38.876923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:38.877467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:38.884954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:38.885451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:38.885926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:38.886639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:38.887100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:38.887531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:38.953246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:38.962561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e4ef4efb-0a57-49fb-8078-28f1a9d24ac9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089460 Sep 06 12:18:38.963147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2196/4412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:39.249624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e03db7a5-e07a-4d1c-88e2-20c30cf34acd tempest-TestVolumeBootPattern-1338939541 tempest-TestVolumeBootPattern-1338939541-project] Calling method '.version_select at 0x7f97f4fad550>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:39.280245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e03db7a5-e07a-4d1c-88e2-20c30cf34acd tempest-TestVolumeBootPattern-1338939541 tempest-TestVolumeBootPattern-1338939541-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2126059385" status: 202 len: 0 microversion: 2.1 time: 0.035810 Sep 06 12:18:39.281812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2217/4413] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Sep 6 12:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2126059385 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:18:39.700366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:39.700982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:39.706998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:39.707559 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:39.707935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:39.709198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:39.709699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:39.710148 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:39.979964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:39.985914 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:39.986533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:39.989634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d13048de-663e-4afd-b303-df85ac5fc0e8 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.293059 Sep 06 12:18:39.990245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2197/4414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:39 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:39.994188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:39.994691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:39.995128 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:39.996113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:39.996272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:39.997309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:40.061984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:40.070640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cd7b578d-9f43-426c-b527-94a2c1b3aecf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088643 Sep 06 12:18:40.071221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2218/4415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:41.014285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:41.015050 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:41.022952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:41.023464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:41.023893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:41.024604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:41.025064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:41.025488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:41.100738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:41.102040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:41.113901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:41.114824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:41.116143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:41.117425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:41.118321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:41.119103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:41.208987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:41.220398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1dcba98e-83f4-4c91-aa37-13964ed3847a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.127525 Sep 06 12:18:41.221174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2219/4416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:41.300715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:41.317552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-98696fbe-4815-4768-b694-5eab3ef01144 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.305766 Sep 06 12:18:41.319432 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2198/4417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:41 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:42.245095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:42.245730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:42.253810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:42.254380 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:42.254896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:42.256268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:42.256884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:42.257319 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:42.324291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:42.332757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6adf86f3-e74e-4898-8b15-90e609871b05 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091567 Sep 06 12:18:42.333338 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2220/4418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:42.346731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:42.347344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:42.354474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:42.355391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:42.355860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:42.356766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:42.357219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:42.357838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:42.580191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:42.591436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1e2e5b4-ca16-498e-9bcd-e1657c4587dd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.248536 Sep 06 12:18:42.605736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2199/4419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:42 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:43.357140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:43.357701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:43.364498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:43.366234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:43.366689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:43.367395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:43.367854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:43.368282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:43.456326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:43.465526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4100dae2-8ef1-48e4-aa0b-5fe8acaf1371 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.112241 Sep 06 12:18:43.466169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2221/4420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:43.616976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:43.617672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:43.624409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:43.624889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:43.625319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:43.626039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:43.626488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:43.626906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:43.763066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:43.772966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7b41d7fa-31b5-4fb9-b169-dda56ed73001 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.160336 Sep 06 12:18:43.774312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2200/4421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:43 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:44.499118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:44.499722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:44.516583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:44.517659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:44.518277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:44.519062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:44.519813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:44.520275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:44.608876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:44.622506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8bb6086b-9a42-4aac-80d4-04bc7f3c6aae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.127094 Sep 06 12:18:44.623309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2222/4422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:44.799538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:44.800797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:44.810595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:44.811041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:44.811633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:44.812808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:44.813817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:44.814736 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:45.016833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:45.027221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-334c58b5-52d6-4f3e-b598-2573c26dfd70 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.232123 Sep 06 12:18:45.027976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2201/4423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:44 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:45.645784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:45.646435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:45.653390 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:45.653934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:45.654373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:45.655082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:45.655539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:45.655963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:45.732781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:45.742925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a947605f-b46c-47b2-aefe-b18df93e72d7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.101057 Sep 06 12:18:45.743514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2223/4424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:46.057059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:46.059183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:46.074382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:46.097537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:46.098669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:46.100261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:46.100794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:46.101449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:46.345759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:46.366231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-73c56a1e-15ce-4bf0-bd2b-26fc8a3c0a83 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.318620 Sep 06 12:18:46.375841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2202/4425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:46 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:46.774211 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:46.776323 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:46.784718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:46.785530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:46.786373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:46.787950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:46.788619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:46.790151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:46.890357 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:46.899302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fdeda432-8c11-46e9-a85d-11a0dea22278 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.130105 Sep 06 12:18:46.899896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2224/4426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:47.388451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:47.389219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:47.396179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:47.396899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:47.397340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:47.398075 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:47.398691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:47.399271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:47.555617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:47.569403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-686dc0bb-8891-4b9d-aa2c-d28ee02202c4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.184708 Sep 06 12:18:47.570023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2203/4427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:47 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:47.923979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:47.924601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:47.935158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:47.935158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:47.935158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:47.935158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:47.935516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:47.935516 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:48.003858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:48.014182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eebbf4a3-f894-4ca9-9f52-d09adf9937e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.094006 Sep 06 12:18:48.014770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2225/4428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:48.595782 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:48.596352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: e8593b18-2abc-4a13-9c4a-3515edd30fd0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:48.604399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:48.605154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:48.605656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:48.606580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:48.607057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:48.607485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:48.746357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:48.756106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-434a088b-1fa0-41a5-9fa0-b72da93d06e7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0" status: 200 len: 1735 microversion: 2.1 time: 0.164534 Sep 06 12:18:48.756706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2204/4429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:48 2022] GET /compute/v2.1/servers/e8593b18-2abc-4a13-9c4a-3515edd30fd0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:48.779343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-36d70f88-f38d-4b06-88d2-39b319c5e50f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '.version_select at 0x7f97f4f3b160>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:48.801022 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-36d70f88-f38d-4b06-88d2-39b319c5e50f tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-446791067" status: 202 len: 0 microversion: 2.1 time: 0.025869 Sep 06 12:18:48.801617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2226/4430] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 6 12:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-446791067 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:18:49.040122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:49.040875 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:49.047684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:49.048320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:49.048822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:49.049704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:49.050246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:49.050796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:49.127981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:49.141077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-feec153c-0cfb-4239-a453-e21960e6a54b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.106024 Sep 06 12:18:49.141686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2205/4431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:49.825767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-da9a462c-0408-4a28-9c66-2258dbfa2d45 req-b27b08b3-92fc-46b6-905e-15331f21dc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:18:49.842040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-da9a462c-0408-4a28-9c66-2258dbfa2d45 req-b27b08b3-92fc-46b6-905e-15331f21dc7c service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:49.842520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-da9a462c-0408-4a28-9c66-2258dbfa2d45 req-b27b08b3-92fc-46b6-905e-15331f21dc7c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:49.842956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-da9a462c-0408-4a28-9c66-2258dbfa2d45 req-b27b08b3-92fc-46b6-905e-15331f21dc7c service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:49.855500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-da9a462c-0408-4a28-9c66-2258dbfa2d45 req-b27b08b3-92fc-46b6-905e-15331f21dc7c service nova] Creating event network-changed:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 12:18:49.861265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-da9a462c-0408-4a28-9c66-2258dbfa2d45 req-b27b08b3-92fc-46b6-905e-15331f21dc7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043245 Sep 06 12:18:49.862524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2227/4432] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:18:50.166097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:50.166810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:50.174225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:50.174813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:50.175333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:50.176116 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:50.176666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:50.177785 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:50.255330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:50.265498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6cb1f896-28ea-4423-be96-b5c1311a453c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.104199 Sep 06 12:18:50.266315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2206/4433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:51.290283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:51.290925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:51.298162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:51.298654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:51.299085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:51.299797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:51.300247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:51.300673 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:51.368007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:51.377243 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-672e9140-17c2-4ed7-a39d-b456f25bac7d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092051 Sep 06 12:18:51.377878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2228/4434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:52.403324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:52.404382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:52.411215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:52.412715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:52.413173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:52.413911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:52.414373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:52.414803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:52.424435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:52.424968 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:52.433196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:52.433720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:52.434164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:52.434920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:52.435382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:52.435874 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:52.463245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f73e7539-5762-426d-ad43-047d33beb9b7 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71/ips" status: 200 len: 151 microversion: 2.20 time: 0.042572 Sep 06 12:18:52.463879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2229/4435] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Sep 6 12:18:52 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 12:18:52.484921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:52.493910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-febea071-9042-4eb3-8f41-378fba359511 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095055 Sep 06 12:18:52.494496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2207/4436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:53.518187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:53.518727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:53.525509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:53.526046 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:53.526497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:53.527470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:53.527933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:53.528409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:53.600350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:53.609210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e5eacbf7-bcb3-4c09-9c48-d1094d90474c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095369 Sep 06 12:18:53.609920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2230/4437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:18:54.634479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:54.635038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:54.641856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:54.642354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:54.642796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:54.643516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:54.643977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:54.644410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:54.736738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:54.745928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c37baff-c5f6-40c3-9db2-6e529d87a73f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.116111 Sep 06 12:18:54.746516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2208/4438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:55.773301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:55.773952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:55.780879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:55.781368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:55.781862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:55.782570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:55.783035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:55.783473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:55.853183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:55.862307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e3fbae75-566a-4176-b91f-ccec77363300 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093462 Sep 06 12:18:55.863240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2231/4439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:56.886556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:56.887195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:56.893946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:56.894433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:56.894874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:56.895588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:56.896663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:56.897097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:56.970515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:56.979262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f98c54e3-ae6b-45be-959d-b69bc753ab5e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.096556 Sep 06 12:18:56.979827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2209/4440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:58.003484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:58.004097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:58.011105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:58.011605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:58.012051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:58.012776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:58.013235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:58.013684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:58.081815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:58.092764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-56f8acbe-4666-45fd-b67c-a0bdbea795e4 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093247 Sep 06 12:18:58.095221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2232/4441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:18:58.849945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:58.850533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:58.857246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:58.857771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:58.858229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:58.859702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:58.859702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:58.859979 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:58.886817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aec5d125-8c72-43b5-a3d2-76fd214446af tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839/ips" status: 200 len: 149 microversion: 2.1 time: 0.040974 Sep 06 12:18:58.887415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2210/4442] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:18:58 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:18:59.117955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:18:59.118489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:18:59.125222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:59.125747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:59.126197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:59.126902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:18:59.127366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:18:59.127795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:18:59.193092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:18:59.201291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41b0d98d-a110-4422-8460-ca88b9205d61 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087811 Sep 06 12:18:59.201921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2233/4443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:18:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:00.225827 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:00.226545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:00.233368 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:00.233901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:00.234349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:00.235071 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:00.235537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:00.235972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:00.304346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:00.313074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-20b439d3-1fec-4f0b-a768-ca7684083270 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091238 Sep 06 12:19:00.313698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2211/4444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:01.340295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:01.340937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:01.347870 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:01.348366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:01.349532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:01.351373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:01.351859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:01.352297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:01.423124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:01.432509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e74d6b78-b2da-43e8-a64b-57ec9ce1b0a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097327 Sep 06 12:19:01.433100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2234/4445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:02.459621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:02.461037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:02.467473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=46 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:02.469209 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:02.469851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:02.470406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:02.471198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:02.471733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:02.472304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:02.491130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=100 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:02.548004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:02.573462 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-168b4da3-cf80-49d8-93bd-04d798d3ca39 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.120676 Sep 06 12:19:02.585682 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2212/4446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:03.608721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:03.609420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:03.618235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:03.618737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:03.619178 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:03.619921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:03.620383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:03.620807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:03.703685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:03.706734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:03.717293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6e008e7-163e-4c7e-a667-115d7c639334 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.111959 Sep 06 12:19:03.718093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2235/4447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:04.656932 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-ee460258-3f66-4f02-aa85-91e1ea6957e7 req-6fc32323-fe44-48e8-ba7b-ae85ceb509c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cb205f-f79a-4c52-b0e3-190868135839", "name": "network-vif-deleted", "tag": "f1f133bf-a5b0-4fa4-a620-a0a7431dee95"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:19:04.670230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-ee460258-3f66-4f02-aa85-91e1ea6957e7 req-6fc32323-fe44-48e8-ba7b-ae85ceb509c1 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:04.670986 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-ee460258-3f66-4f02-aa85-91e1ea6957e7 req-6fc32323-fe44-48e8-ba7b-ae85ceb509c1 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:04.671441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-ee460258-3f66-4f02-aa85-91e1ea6957e7 req-6fc32323-fe44-48e8-ba7b-ae85ceb509c1 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:04.685676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-ee460258-3f66-4f02-aa85-91e1ea6957e7 req-6fc32323-fe44-48e8-ba7b-ae85ceb509c1 service nova] Creating event network-vif-deleted:f1f133bf-a5b0-4fa4-a620-a0a7431dee95 for instance 23cb205f-f79a-4c52-b0e3-190868135839 on hv-cinder-85604 Sep 06 12:19:04.691671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-ee460258-3f66-4f02-aa85-91e1ea6957e7 req-6fc32323-fe44-48e8-ba7b-ae85ceb509c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038319 Sep 06 12:19:04.692799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2213/4448] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:19:04.744365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:04.744970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:04.747567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:04.754055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:04.754528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:04.755559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:04.756333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:04.756735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:04.757170 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:04.833521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:04.843324 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-195c009c-192e-4bdb-b0b9-384d685c855a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.104891 Sep 06 12:19:04.843921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2236/4449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:19:05.869726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:05.870539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:05.877286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:05.877945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:05.878475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:05.879370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:05.880484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:05.880975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:05.953964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:05.964444 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5e9cb12b-6576-46e7-bdc1-42e6707e526a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.100039 Sep 06 12:19:05.965240 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2214/4450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:06.992422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:06.993105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:07.000440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:07.000935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:07.001372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:07.002130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:07.002599 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:07.003026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:07.074626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:07.084975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-10ef8ed0-f759-4b2e-a2cd-c4bff9bb7e9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.098459 Sep 06 12:19:07.085602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2237/4451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:08.116215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:08.116993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:08.126591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:08.127393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:08.128152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:08.129320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:08.130205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:08.130935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:08.213420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:08.224348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3484a58f-3aa0-45ba-97f9-101f2a213d35 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.115924 Sep 06 12:19:08.225213 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2215/4452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:09.248281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:09.248924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:09.256126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:09.256628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:09.257080 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:09.257835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:09.258298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:09.258733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:09.328086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:09.337090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d56cf2fe-3b1c-4212-ac5b-2a7333e528c7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092827 Sep 06 12:19:09.337693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2238/4453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:19:10.365402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:10.366017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:10.372775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:10.373317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:10.373839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:10.374585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:10.375110 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:10.375572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:10.445205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:10.453795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d767acea-eda9-4445-9722-40589fdae4d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092787 Sep 06 12:19:10.454393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2216/4454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:11.478805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:11.479435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:11.486260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:11.486752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:11.487199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:11.487909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:11.488367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:11.488795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:11.564621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:11.574272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ad8ce852-9b8f-4105-855d-81177b4f296d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.099585 Sep 06 12:19:11.574848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2239/4455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:12.597593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:12.598724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:12.605398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:12.605936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:12.606377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:12.607092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:12.607561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:12.607991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:12.679018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:12.687678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-504c8913-2fd4-4382-9657-56f9fa3028c0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.094041 Sep 06 12:19:12.688266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2217/4456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:13.711097 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:13.711702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:13.719823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:13.720326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:13.720769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:13.721481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:13.722004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:13.722442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:13.795233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:13.804391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-61f06169-3160-45b7-aed9-f61e41f58a73 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097218 Sep 06 12:19:13.804975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2240/4457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:14.828794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:14.829365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:14.837367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:14.837892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:14.838331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:14.839033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:14.839489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:14.839917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:14.903670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:14.914460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1e44f095-7716-441f-9fd3-4f2660514958 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089735 Sep 06 12:19:14.915060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2218/4458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:15.949363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:15.950105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:15.957087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:15.957596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:15.958095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:15.958812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:15.959275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:15.959706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:16.026529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:16.035257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-84335e67-e915-40dc-bbf5-c437ce33761b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090079 Sep 06 12:19:16.036113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2241/4459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:17.058870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:17.059468 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:17.065903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:17.066389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:17.067294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:17.068176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:17.068436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:17.068853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:17.132660 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:17.141042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b0b233a6-806c-46ac-969d-85ba9bc89354 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085993 Sep 06 12:19:17.141620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2219/4460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:18.170481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:18.171121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:18.179028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:18.179508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:18.179938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:18.180622 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:18.181071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:18.181491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:18.245857 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:18.255149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eac217fe-debc-41ed-b79b-7a8ee35ab383 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087737 Sep 06 12:19:18.255770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2242/4461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:19.279461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:19.280195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:19.287832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:19.288356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:19.288768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:19.289501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:19.289977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:19.290414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:19.361508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:19.378910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6fc154d9-a9e5-4590-bf4c-4b6f7a0de527 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.103318 Sep 06 12:19:19.380379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2220/4462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:20.407134 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:20.407745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:20.415055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:20.415543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:20.415981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:20.416678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:20.417130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:20.417549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:20.484166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:20.493469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5f1e6bc9-da47-40a0-8f87-29766694d805 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090202 Sep 06 12:19:20.494336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2243/4463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:21.521552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:21.522139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:21.529354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:21.529890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:21.530332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:21.531040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:21.531499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:21.531928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:21.600946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:21.609383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-303f092a-79f1-4d60-91e3-53213151c8df tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092625 Sep 06 12:19:21.610017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2221/4464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:22.635649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:22.636215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:22.643051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:22.643577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:22.644021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:22.644731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:22.646202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:22.646659 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:22.719711 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:22.729268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-322c2827-8574-4b98-b185-4701b0277889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097509 Sep 06 12:19:22.729892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2244/4465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:23.758176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:23.758786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:23.765362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:23.765896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:23.766342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:23.767053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:23.767511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:23.767938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:23.837861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:23.846718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a12a784e-662b-47c8-b81d-b02d054d7b10 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092970 Sep 06 12:19:23.847310 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2222/4466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:24.870829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:24.871503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:24.878272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:24.878769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:24.879257 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:24.880608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:24.881039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:24.881481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:24.956003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:24.964793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-77f32471-dad3-4b49-85c8-372580e91844 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097793 Sep 06 12:19:24.965386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2245/4467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:25.989545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:25.990178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:25.997721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:25.998217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:25.998662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:25.999363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:25.999814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:26.000241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:26.066278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:26.075597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2c2c63aa-0fb4-4c99-9856-068ad344a321 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090374 Sep 06 12:19:26.076177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2223/4468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:27.099185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:27.099775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:27.105876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:27.106412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:27.106845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:27.107557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:27.108185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:27.108689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:27.172120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:27.181349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ae1fde45-2993-40c2-9372-2a2bfe5d4432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086161 Sep 06 12:19:27.181959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2246/4469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:28.204765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:28.205380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:28.212771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:28.213252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:28.213720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:28.214413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:28.214868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:28.215294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:28.279474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:28.287947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-73a5e115-8a28-455b-803b-336568a2aeae tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087040 Sep 06 12:19:28.288522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2224/4470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:29.311545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:29.312197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:29.319182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:29.319690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:29.320166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:29.321005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:29.321529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:29.322073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:29.386203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:29.395194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8f3a5cbb-fe27-4614-833b-579f168fbae1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087689 Sep 06 12:19:29.395784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2247/4471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:30.419380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:30.419993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:30.426719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:30.427205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:30.427812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:30.428959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:30.429583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:30.430040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:30.498651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:30.507151 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8742b254-77ad-4434-b3a5-93757a6a7fa2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091571 Sep 06 12:19:30.507663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2225/4472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:31.530071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:31.530897 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:31.537514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:31.538041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:31.538471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:31.539162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:31.539611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:31.540033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:31.609252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:31.618557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b4856a09-82f9-428b-a45c-b8cdcd5d10ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092677 Sep 06 12:19:31.619144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2248/4473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:32.644415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:32.644980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:32.648738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:32.653346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:32.653877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:32.654320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:32.655094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:32.655556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:32.655983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:32.658940 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=78 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:32.741852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:32.750894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f3bb1f8-1b7d-4c56-a35b-4fc4b928e80c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.111215 Sep 06 12:19:32.751483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2226/4474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:33.775309 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:33.775921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:33.782523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:33.783002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:33.783433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:33.784113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:33.784562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:33.784981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:33.788117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=80 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:33.848624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:33.857606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3a88784f-937f-47f2-b9d0-eaafe069770a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086636 Sep 06 12:19:33.858196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2249/4475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:34.880391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:34.881010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:34.888015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:34.888495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:34.888966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:34.889605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:34.890077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:34.890500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:34.952066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:34.960607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc56f118-b1a3-4fe9-b232-adfb6ae50095 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084115 Sep 06 12:19:34.961174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2227/4476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:35.984369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:35.984959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:35.987384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:19:35.993423 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:35.993883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:35.994328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:35.995030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:35.995529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:35.995961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:36.060069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:36.068342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bac72d9a-4133-45fe-892c-e8958880e3a0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087786 Sep 06 12:19:36.069550 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2250/4477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:37.092750 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:37.093399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:37.100211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:37.100692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:37.101131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:37.101851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:37.102311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:37.102757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:37.166517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:37.174673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a36bd660-6424-416b-abce-64a884644c8d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086049 Sep 06 12:19:37.175248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2228/4478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:38.197901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:38.198519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:38.204930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:38.205418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:38.205881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:38.206577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:38.207033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:38.207460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:38.272572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:38.281163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-12130982-6ce5-405f-9aa5-95893f46ffba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087154 Sep 06 12:19:38.281751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2251/4479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:39.304231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:39.304832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:39.311424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:39.311913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:39.312348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:39.313053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:39.313509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:39.313964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:39.381452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:39.389895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-600ad716-927a-4514-bcdd-5e2b237c3e79 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089437 Sep 06 12:19:39.390470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2229/4480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:40.415951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:40.416575 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:40.423453 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:40.424074 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:40.424377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:40.425087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:40.425548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:40.426009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:40.496175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:40.505061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ccf08861-0cda-4ad0-ad59-6f2e22182608 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093620 Sep 06 12:19:40.506695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2252/4481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:41.529277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:41.529868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:41.546533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:41.547045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:41.547491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:41.548210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:41.548671 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:41.549095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:41.628037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:41.637447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-90e13a70-ef31-4f1d-982a-cb8fc4f7c681 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.112466 Sep 06 12:19:41.638057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2230/4482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:42.661867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:42.662621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:42.670007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:42.670497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:42.670939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:42.671640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:42.672099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:42.672525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:42.735810 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:42.744331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7bdfef56-c085-4bca-b301-4a57330e158b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086467 Sep 06 12:19:42.744894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2253/4483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:43.767283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:43.767900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:43.775076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:43.775567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:43.776006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:43.776702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:43.777429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:43.777885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:43.840501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:43.849038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-545ef6be-f757-48a1-8f87-cf3ce9fcb1e2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085613 Sep 06 12:19:43.849547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2231/4484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:44.873184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:44.873837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:44.880854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:44.881342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:44.881827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:44.882637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:44.883124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:44.883549 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:44.947883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:44.956144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9ea268c3-8bfb-479e-83ab-4db7014ca5b2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086903 Sep 06 12:19:44.956718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2254/4485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:45.979908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:45.980620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:45.987030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:45.987513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:45.987950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:45.988638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:45.989090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:45.989515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:46.051976 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:46.061074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22ab1eee-3ab1-405d-824c-955ce27f9693 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085028 Sep 06 12:19:46.061659 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2232/4486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:47.085086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:47.085734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:47.092367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:47.092858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:47.093300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:47.094038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:47.094500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:47.094930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:47.159221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:47.168350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1b1bf84e-67c9-4674-beb9-fb309f4e8ba0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087610 Sep 06 12:19:47.168948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2255/4487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:48.191973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:48.192622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:48.200388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:48.200942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:48.201414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:48.202176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:48.202666 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:48.203145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:48.280231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:48.289354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f0517dc0-e69b-4dc3-9796-c8f4b7923560 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.101588 Sep 06 12:19:48.289977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2233/4488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:49.314381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:49.315086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:49.322608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:49.323105 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:49.323548 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:49.324250 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:49.324710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:49.325137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:49.395016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:49.405989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dcc5f59b-ac07-456d-954b-d887114d785a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095814 Sep 06 12:19:49.406726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2256/4489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:50.429753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:50.430361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:50.436870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:50.437364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:50.437846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:50.438543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:50.439001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:50.439431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:50.503183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:50.511900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8532d734-30bd-4d8c-ad61-42712c01991e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086190 Sep 06 12:19:50.512469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2234/4490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:51.535931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:51.536469 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:51.543861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:51.544344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:51.544785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:51.545525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:51.546054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:51.546483 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:51.611627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:51.620889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-83452168-cb96-4f7a-8090-45be80b61044 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088925 Sep 06 12:19:51.621466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2257/4491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:52.644354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:52.644967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:52.651764 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:52.652509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:52.652951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:52.653681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:52.654137 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:52.654566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:52.718807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:52.727608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09cbc008-52db-4402-a169-17b0b891a3bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087370 Sep 06 12:19:52.728191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2235/4492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:53.752300 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:53.752913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:53.759653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:53.760189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:53.760667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:53.761515 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:53.762108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:53.762623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:53.830056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:53.841009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-264be9fd-1194-43cb-81ad-781c1ad58aea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093543 Sep 06 12:19:53.841639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2258/4493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:54.868967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:54.869595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:54.876105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:54.876585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:54.877018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:54.877738 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:54.878193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:54.878618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:54.942636 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:54.951082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0a8cb298-3e45-472e-920e-0ce1f2c503b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087434 Sep 06 12:19:54.951673 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2236/4494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:55.975530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:55.976139 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:55.982999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:55.983495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:55.983935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:55.984641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:55.985098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:55.985523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:56.212648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:56.221007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5307675e-7152-44cf-8ad3-04b97138aa7f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.249774 Sep 06 12:19:56.221582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2259/4495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:57.245237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:57.245959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:57.253210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:57.253835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:57.254193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:57.254921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:57.255386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:57.255821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:57.327335 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:57.335797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a6b41af1-98c2-446f-9011-25d9801bf6ed tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095041 Sep 06 12:19:57.337192 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2237/4496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:19:58.359832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:58.360454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:58.366601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:58.367111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:58.367557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:58.368273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:58.368735 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:58.369166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:58.434175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:58.442585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8646cb7f-107d-478f-8212-2754192312dc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086822 Sep 06 12:19:58.443171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2260/4497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:19:59.469374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:19:59.470020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:19:59.482273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:59.482806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:59.483257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:59.484009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:19:59.484470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:19:59.484902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:19:59.555806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:19:59.564749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5c3ff0c3-194d-47dd-bd41-813e2248568f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.099609 Sep 06 12:19:59.565402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2238/4498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:19:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:00.589284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:00.589844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:00.596401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:00.596907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:00.597336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:00.598064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:00.598520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:00.598957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:00.917433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:00.925745 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ac7d0d87-ceef-42d6-afb1-87778ec010b5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.340681 Sep 06 12:20:00.926354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2261/4499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:00 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:01.950154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:01.950807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:01.957313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:01.957829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:01.958270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:01.958954 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:01.959410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:01.959839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:02.020846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:02.029467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-db7be7f0-d216-438d-9c18-4295a9ddb5c6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083188 Sep 06 12:20:02.030078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2239/4500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:03.052695 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:03.053295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:03.059825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:03.060306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:03.060732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:03.061410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:03.061893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:03.062311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:03.124280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:03.132495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b99b4400-5631-4f06-8f63-5d1acfa49773 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083677 Sep 06 12:20:03.133062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2262/4501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:04.155709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:04.156289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:04.158623 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:04.163928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:04.164413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:04.164910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:04.165605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:04.166086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:04.166515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:04.169222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=84 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:04.229171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:04.237434 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-db46fb4d-c1f2-4595-a773-ffcbc123aabc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085955 Sep 06 12:20:04.238036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2240/4502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:05.261015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:05.261665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:05.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:05.268583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:05.269013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:05.269725 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:05.270183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:05.270612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:05.274492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=84 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:05.340653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:05.350079 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-eb4bdb44-7864-4f38-805c-55ff5b4bcbe3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093642 Sep 06 12:20:05.350648 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2263/4503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:06.373633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:06.374285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:06.380759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:06.381247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:06.381718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:06.382414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:06.382872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:06.383303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:06.450531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:06.458725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8808acd1-3dda-40e9-91da-c89124848261 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089117 Sep 06 12:20:06.459289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2241/4504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:07.484689 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:07.485427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:07.487370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:07.492815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:07.493305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:07.493779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:07.494474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:07.495623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:07.496111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:07.558185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:07.566428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-24322d9f-0024-43b7-b75c-cdb69077c2a8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087308 Sep 06 12:20:07.566984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2264/4505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:08.591768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:08.592332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:08.598808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:08.599296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:08.599733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:08.600452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:08.600910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:08.601339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:08.666163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:08.675112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-89e8dc70-56c1-4bf9-8525-0a5baea0290a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087548 Sep 06 12:20:08.675742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2242/4506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:09.699270 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:09.699884 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:09.706498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:09.706992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:09.707434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:09.708127 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:09.708586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:09.709021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:09.774750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:09.783272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e4280d98-03fc-4f4d-b5ba-8c9b60f726fd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088149 Sep 06 12:20:09.783847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2265/4507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:10.806888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:10.808492 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:10.814397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:10.814906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:10.815347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:10.816038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:10.816499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:10.816928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:10.878621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:10.887834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-aa3ae81c-2514-4481-abcc-d300bbca0882 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085045 Sep 06 12:20:10.888416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2243/4508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:10 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:11.911334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:11.911948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:11.918538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:11.919027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:11.919464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:11.920151 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:11.920610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:11.921039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:11.982579 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:11.990777 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-62415d45-9d4c-4e80-beb8-79e9c0e7b5f7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083346 Sep 06 12:20:11.991354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2266/4509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:13.013906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:13.014512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:13.020851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:13.021331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:13.021788 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:13.022746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:13.023200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:13.023640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:13.086627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:13.095516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-68e25713-ff65-416d-90a3-3f306ed4bc86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085578 Sep 06 12:20:13.096025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2244/4510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:14.119466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:14.120089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:14.126654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:14.127147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:14.127589 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:14.128291 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:14.128754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:14.129180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:14.193394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:14.203089 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d990ec8d-29be-4eb1-be68-035a7a62c669 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087645 Sep 06 12:20:14.203677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2267/4511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:15.227162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:15.227769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:15.234797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:15.235291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:15.235724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:15.236406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:15.236858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:15.237278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:15.303474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:15.311910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7ca01677-5ae8-42a6-954b-40f4b79c315a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088631 Sep 06 12:20:15.312497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2245/4512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:16.335868 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:16.336488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:16.343786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:16.344279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:16.344724 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:16.345429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:16.345929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:16.346361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:16.410641 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:16.420038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-450d5aa9-ec6d-46d6-983c-c18b189fdaa0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087972 Sep 06 12:20:16.420635 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2268/4513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:17.442686 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:17.443301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:17.450154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:17.450644 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:17.451093 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:17.451784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:17.452246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:17.452672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:17.514629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:17.522839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fb2377de-baef-4fcb-a4fe-a1678607990e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084019 Sep 06 12:20:17.523413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2246/4514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:18.547843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:18.548475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:18.554848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:18.555332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:18.555772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:18.556470 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:18.557508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:18.558118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:18.622354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:18.630499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-af1de3d7-d25e-408b-a0fa-f9db7f9666bb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086763 Sep 06 12:20:18.631069 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2269/4515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:19.655720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:19.656283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:19.662743 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:19.663224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:19.663662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:19.664347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:19.664807 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:19.665233 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:19.726241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:19.735621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a8a5442a-c4f7-4199-87eb-d21b4aad1114 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084671 Sep 06 12:20:19.736199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2247/4516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:20.759041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:20.759677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:20.766432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:20.766921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:20.767362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:20.768090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:20.768554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:20.768981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:20.833460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:20.842266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-42b55e7f-7b1e-4aa6-b046-83cb7aca141c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087114 Sep 06 12:20:20.842832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2270/4517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:20 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:21.865522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:21.866179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:21.873182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:21.873681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:21.874119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:21.874801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:21.875252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:21.875674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:21.940030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:21.948047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6b9e0987-1ca7-4e3d-9f8e-fc81cf92c9de tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086317 Sep 06 12:20:21.948610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2248/4518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:22.971527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:22.972142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:22.978633 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:22.979954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:22.980296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:22.981036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:22.981482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:22.981944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:23.047240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:23.055425 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c7fb944d-a20d-4003-bb61-2011c34d4871 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087789 Sep 06 12:20:23.056001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2271/4519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:24.078478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:24.079021 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:24.085390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:24.085913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:24.086352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:24.087057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:24.087493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:24.087921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:24.156479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:24.164717 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-04d01ac9-d577-4c7e-b6c4-c489a7e2967e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090182 Sep 06 12:20:24.165290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2249/4520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:25.188835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:25.189484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:25.196016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:25.196503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:25.196941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:25.198477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:25.198948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:25.199384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:25.264083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:25.272518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-34a419fd-86a4-4216-903a-a8bd6db9f178 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087566 Sep 06 12:20:25.273096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2272/4521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:26.295901 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:26.296514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:26.302972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:26.303459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:26.303900 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:26.304588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:26.305045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:26.305474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:26.367833 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:26.376620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa33a203-4da7-4446-aaf6-da277fa9a5f6 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084737 Sep 06 12:20:26.377193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2250/4522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:27.402972 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:27.403502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:27.409400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:27.409912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:27.410349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:27.411027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:27.411474 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:27.411904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:27.476927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:27.490537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1e3035a3-8b5c-4254-9f63-8935a65e34d9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092571 Sep 06 12:20:27.491133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2273/4523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:20:28.513800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:28.514337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:28.520722 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:28.521216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:28.521672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:28.522369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:28.522828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:28.523256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:28.585045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:28.593329 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d1d9d150-b9a6-47e9-8558-095c8569df04 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083649 Sep 06 12:20:28.593936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2251/4524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:29.617606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:29.618200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:29.625036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:29.625517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:29.625984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:29.626665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:29.627121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:29.627560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:29.690513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:29.699235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cfa51f8b-75d7-47a2-8a7b-5de3e03c500a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085591 Sep 06 12:20:29.699811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2274/4525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:30.722129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:30.722747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:30.724753 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:20:30.724905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 (ip 10.222.0.18) !!! Sep 06 12:20:30.733867 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:30.734347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:30.734808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:30.735497 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:30.735943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:30.736362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:30.798256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:30.806311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3a965769-74ff-42cb-83e2-0189a1ca47cf tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088093 Sep 06 12:20:30.807914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2252/4526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:31.834901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:31.838501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:31.846592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:31.847071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:31.847499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:31.848183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:31.848636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:31.849049 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:31.910885 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:31.920509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-636c2205-3b85-486c-a116-ddcb00bd445c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088537 Sep 06 12:20:31.921455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2275/4527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:32.944268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:32.944889 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:32.952439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:32.952928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:32.953369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:32.954090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:32.954576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:32.955008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:33.021387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:33.030952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-de441f82-7479-4c43-9e19-7b21dd6e2b6e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090482 Sep 06 12:20:33.031541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2253/4528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:34.053889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:34.054526 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:34.060980 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:34.061468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:34.061932 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:34.062981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:34.063762 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:34.064313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:34.126701 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:34.135623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8ba66c5c-7380-4ebe-8235-42de50ee00f2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085643 Sep 06 12:20:34.136201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2276/4529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:35.159181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:35.159798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:35.162142 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:35.168287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:35.168783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:35.169226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:35.170026 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:35.170485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:35.170914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:35.173825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=84 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:35.466871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:35.475218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b814cd0b-bf13-49f6-8935-34f86613daef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.319854 Sep 06 12:20:35.475808 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2254/4530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:36.501757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:36.502293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:36.509072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:36.509799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:36.510238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:36.510937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:36.511569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:36.511995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:36.514758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=84 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:36.575288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:36.583965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5e8473f6-27d5-4441-8eb5-3bffaf9e5541 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086105 Sep 06 12:20:36.584553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2277/4531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:37.607925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:37.608467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:37.614377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:37.614852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:37.615272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:37.615945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:37.616390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:37.616810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:37.679916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:37.688961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b11a7ea-2d7b-4103-8dd0-865d8e0d5247 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085612 Sep 06 12:20:37.689533 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2255/4532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:38.712999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:38.713611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:38.716475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:20:38.716606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 (ip 10.222.0.18) !!! Sep 06 12:20:38.717795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:20:38.726152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:38.726651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:38.727098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:38.727804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:38.728266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:38.729212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:38.805081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:38.814095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c324ad7-0549-4bbd-b3a2-4ed34e66acd5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.104918 Sep 06 12:20:38.814682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2278/4533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:39.991145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:39.991759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:39.998858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:39.999341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:39.999774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:40.000496 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:40.000952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:40.001380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:40.063178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:40.071450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba7211b7-6859-4fc8-9406-588155817c9b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.235059 Sep 06 12:20:40.072030 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2256/4534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:41.096242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:41.096929 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:41.104577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:41.105083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:41.105541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:41.106518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:41.107014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:41.107707 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:41.178061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:41.189541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5002dda-c41d-4b9a-9f22-a8393e90c273 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.097000 Sep 06 12:20:41.190286 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2279/4535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:42.213503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:42.214133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:42.220561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:42.221053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:42.221467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:42.222178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:42.222629 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:42.223052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:42.285163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:42.293981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b5cfa159-6cd4-4ce3-a094-691888d4cea8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084749 Sep 06 12:20:42.294552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2257/4536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:43.316486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:43.317101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:43.324098 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:43.324586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:43.325024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:43.325750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:43.326215 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:43.326645 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:43.388836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:43.397259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3747a899-db4c-4344-a26e-ea86ea325b38 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084656 Sep 06 12:20:43.397864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2280/4537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:44.421185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:44.421910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:44.423878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:20:44.424058 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:20:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 (ip 10.222.0.18) !!! Sep 06 12:20:44.430194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:44.430692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:44.431139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:44.431994 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:44.432654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:44.433089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:44.497927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:44.507196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0dc2de42-057f-4ccf-9b0b-4ac726b7b8ff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089716 Sep 06 12:20:44.508387 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2258/4538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:20:45.531818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:45.532456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:45.538956 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:45.539447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:45.539890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:45.540586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:45.541588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:45.542071 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:45.607568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:45.615946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-daedc855-dc20-4bfd-9000-3cc860de6ece tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087965 Sep 06 12:20:45.616513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2281/4539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:46.640461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:46.641007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:46.649062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:46.649541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:46.649998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:46.650691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:46.651140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:46.651698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:46.766202 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:46.774355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a48d24f9-1a1e-4366-aad1-682be9889636 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.137899 Sep 06 12:20:46.774914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2259/4540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:47.797887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:47.798508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:47.805055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:47.805544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:47.806023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:47.807335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:47.807797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:47.808226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:47.871621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:47.879826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-daaf51c5-6ee2-4152-b9aa-ab3ee8a0e211 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085866 Sep 06 12:20:47.880396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2282/4541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:48.903967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:48.904627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:48.911094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:48.911582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:48.912025 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:48.912726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:48.913185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:48.913672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:48.975733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:48.984008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7eb92ab5-4e0a-4197-b4b6-8d8d0373b251 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084585 Sep 06 12:20:48.984573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2260/4542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:50.007626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:50.008307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:50.015899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:50.016383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:50.016818 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:50.017508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:50.017991 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:50.018417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:50.083472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:50.092455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7dfc7fc2-c12a-41db-b641-ab886e80de06 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088673 Sep 06 12:20:50.093032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2283/4543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:50 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:51.115345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:51.115998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:51.123022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:51.123519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:51.124265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:51.125077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:51.125538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:51.125995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:51.187911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:51.196078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-16b5dd5f-0029-499f-bba5-c6bf689067aa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084652 Sep 06 12:20:51.196651 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2261/4544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:52.219966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:52.220573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:52.226940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:52.227418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:52.227851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:52.229072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:52.229521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:52.229969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:52.294144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:52.302265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-163d8ed5-e182-4214-93f2-dd5502cbb492 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086135 Sep 06 12:20:52.302843 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2284/4545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:53.327049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:53.327663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:53.334163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:53.334647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:53.335086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:53.335775 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:53.336237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:53.336658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:53.405190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:53.413487 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8347b933-89f0-4645-b7d8-f23191581101 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090526 Sep 06 12:20:53.414103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2262/4546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:54.436797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:54.437514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:54.444381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:54.444858 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:54.445289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:54.445992 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:54.446441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:54.447100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:54.524651 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:54.534422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c6f368f-a421-462a-8f33-226403ff7978 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.101580 Sep 06 12:20:54.535006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2285/4547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:20:55.557677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:55.558363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:55.565011 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:55.565851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:55.566622 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:55.567639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:55.568352 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:55.568916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:55.631786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:55.640312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f28a0db9-3044-4337-a046-5c1798c52543 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087291 Sep 06 12:20:55.640899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2263/4548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:56.663941 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:56.664588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:56.670834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:56.671352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:56.671764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:56.672446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:56.672911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:56.673336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:56.734824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:56.742984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-373a6833-dd81-4fdb-8631-3fe62dc31468 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083097 Sep 06 12:20:56.744688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2286/4549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:57.766663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:57.767271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:57.773605 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:57.774119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:57.774556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:57.776439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:57.776906 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:57.777586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:57.840513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:57.848590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b2d2c323-915b-4ef1-95b4-15b90b5c9274 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085841 Sep 06 12:20:57.849150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2264/4550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:58.871457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:58.872068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:58.879299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:58.879782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:58.880218 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:58.880900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:58.881356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:58.881886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:58.948057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:20:58.957083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5fb3d7b7-565e-436e-8573-1942e9df3cf7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089532 Sep 06 12:20:58.957679 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2287/4551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:20:59.981509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:20:59.982144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:20:59.988469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:59.988943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:59.989374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:20:59.990080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:20:59.990537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:20:59.990953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:00.052382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:00.061286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2a12dee6-35f1-4e56-865c-35252e641918 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084301 Sep 06 12:21:00.061928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2265/4552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:20:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:01.084437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:01.085115 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:01.092875 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:01.093368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:01.093851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:01.094562 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:01.095017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:01.095445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:01.157961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:01.166378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7bb8df5a-6c12-4776-891a-e4217723e915 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085834 Sep 06 12:21:01.166954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2288/4553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:02.189791 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:02.190403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:02.197356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:02.197868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:02.198302 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:02.198983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:02.199430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:02.199850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:02.264010 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:02.272218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1cebe85d-4367-49f0-ab75-526782bb2d42 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086316 Sep 06 12:21:02.272787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2266/4554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:03.296544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:03.297168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:03.303520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:03.304016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:03.304458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:03.305154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:03.305614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:03.306619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:03.369235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:03.377377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d18916ce-99ab-445f-852e-d4d95726092f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084615 Sep 06 12:21:03.377995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2289/4555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:04.402108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:04.403020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:04.409473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:04.409993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:04.410424 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:04.411106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:04.411551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:04.411967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:04.474995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:04.483205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-754dfb05-4443-463b-88d9-0469b2c89fc9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085835 Sep 06 12:21:04.483755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2267/4556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:05.506306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:05.506852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:05.513918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:05.514372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:05.514805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:05.515493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:05.515950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:05.516375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:05.582779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:05.592125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0389326d-914f-408d-9310-32e676723e78 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089803 Sep 06 12:21:05.592692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2290/4557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:06.616759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:06.617727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:06.622113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:06.628205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:06.628698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:06.629139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:06.629903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:06.630350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:06.630779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:06.633675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=84 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:06.697777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:06.705913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f1f8a5ad-d0c5-4a49-9216-6fa913b26763 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093208 Sep 06 12:21:06.706489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2268/4558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:21:07.728924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:07.729538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:07.736033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:07.736519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:07.736959 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:07.737670 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:07.738140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:07.738570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:07.742493 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=84 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:07.805506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:07.814444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f2663858-dd9c-493c-aa66-70ff200ab676 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089414 Sep 06 12:21:07.815023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2291/4559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:08.838350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:08.838910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:08.845395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:08.845921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:08.846363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:08.847065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:08.847521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:08.847952 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:08.908934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:08.918251 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-15ffde1b-8217-45e9-a40a-04426e6d2d6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083893 Sep 06 12:21:08.918832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2269/4560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:09.942657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:09.943275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:09.945698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:09.952289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:09.952892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:09.953388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:09.954208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:09.954717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:09.955194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:10.020220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:10.028768 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a07aa9ba-cd31-4de8-96c7-52021e2ba04c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090019 Sep 06 12:21:10.029341 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2292/4561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:11.052168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:11.052809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:11.059878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:11.060363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:11.060799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:11.061488 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:11.061978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:11.062413 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:11.128354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:11.137796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-44b013b6-3087-4f6e-8f52-87ec1ec687fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089701 Sep 06 12:21:11.138370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2270/4562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:12.161277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:12.161927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:12.169015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:12.169507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:12.169975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:12.170683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:12.171135 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:12.171568 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:12.233143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:12.241336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-74253f3e-ae3f-4118-a3f3-7583f72fb593 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083939 Sep 06 12:21:12.241957 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2293/4563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:13.265364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:13.266136 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:13.272859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:13.273344 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:13.273811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:13.274505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:13.274961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:13.276115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:13.337537 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:13.346440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d058f6ea-97b5-4aa2-b88c-232ce39bb6fa tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084995 Sep 06 12:21:13.347046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2271/4564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:14.426290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:14.426911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:14.434140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:14.434624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:14.435053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:14.435736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:14.436188 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:14.436609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:14.498634 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:14.507118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2f50db84-f753-4a99-9168-a9a132b67749 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084660 Sep 06 12:21:14.507620 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2294/4565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:15.530991 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:15.531573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:15.538031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:15.538505 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:15.538936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:15.539617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:15.540065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:15.540483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:15.602962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:15.612409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-48262da4-c949-40d7-9a8d-05a6cb1a50bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085478 Sep 06 12:21:15.613034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2272/4566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:16.637320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:16.638096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:16.644537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:16.645043 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:16.645473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:16.646212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:16.646676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:16.647106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:16.713585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:16.721964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7b51fce8-164d-4140-a647-0635cf3edb41 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089570 Sep 06 12:21:16.722553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2295/4567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:17.746205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:17.746803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:17.753336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:17.753853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:17.754288 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:17.754974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:17.755427 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:17.755850 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:17.818182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:17.826834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8dec10f6-42b8-4857-9829-48db7831df9d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084530 Sep 06 12:21:17.827403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2273/4568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:18.850603 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:18.851217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:18.858349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:18.858829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:18.859259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:18.859939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:18.860388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:18.860804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:18.922441 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:18.930781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e561d50c-3d8f-465b-8915-21827b2efe43 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084163 Sep 06 12:21:18.931419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2296/4569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:19.954152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:19.954770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:19.961194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:19.961712 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:19.962154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:19.963331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:19.963543 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:19.963974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:20.031411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:20.039595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2180e47d-2608-4e3c-809d-e3116dd8697e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089283 Sep 06 12:21:20.040170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2274/4570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:21.062999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:21.063618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:21.070246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:21.070742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:21.071186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:21.072368 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:21.072839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:21.073272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:21.140041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:21.148262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ab69df11-23a6-4dff-8cc9-307d10116c91 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089151 Sep 06 12:21:21.148840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2297/4571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:22.173239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:22.173882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:22.180415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:22.180904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:22.181420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:22.182810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:22.183272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:22.183699 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:22.250573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:22.261114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-99dcef06-23a1-4c72-919e-92150d40f30f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091576 Sep 06 12:21:22.261725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2275/4572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:23.285422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:23.286095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:23.292859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:23.293340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:23.293804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:23.294486 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:23.294934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:23.295350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:23.356966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:23.365087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3b831b43-9a9c-4a93-9da0-d2e1e639dbe7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083554 Sep 06 12:21:23.365668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2298/4573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:24.390080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:24.390729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:24.397007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:24.397498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:24.398248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:24.399304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:24.399768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:24.400691 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:24.614962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:24.623346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c1fef7e5-0018-4e96-8285-0ba4640e7990 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.238603 Sep 06 12:21:24.623928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2276/4574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:25.647748 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:25.648325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:25.656383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:25.656862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:25.657292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:25.658003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:25.658454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:25.658872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:25.723997 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:25.732246 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5a498551-a651-43e2-af83-3e48417e26bd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088436 Sep 06 12:21:25.732791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2299/4575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:26.755311 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:26.755930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:26.762618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:26.763092 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:26.763530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:26.764217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:26.764675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:26.765100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:26.826654 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:26.834755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-952121a1-4b8e-49d2-bdee-d386acce5fb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083414 Sep 06 12:21:26.835320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2277/4576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:27.858122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:27.858743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:27.865066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:27.865557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:27.866034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:27.866736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:27.867197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:27.867624 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:27.931184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:27.940475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7dcae38b-2926-44cf-a661-3590adef9a32 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086872 Sep 06 12:21:27.941051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2300/4577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:28.965043 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:28.965678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:28.972171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:28.972650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:28.973094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:28.973805 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:28.974262 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:28.974684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:29.038814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:29.047763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-00f5b535-c97c-4630-832b-069c75bcc332 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087562 Sep 06 12:21:29.048327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2278/4578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:30.070062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:30.070614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:30.078028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:30.078510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:30.078938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:30.079623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:30.080075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:30.080491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:30.142680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:30.150987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9a246638-c6c1-4298-a4f0-5eed187626ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084921 Sep 06 12:21:30.151571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2301/4579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:31.174461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:31.175074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:31.181443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:31.181959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:31.183514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:31.184222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:31.184672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:31.185097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:31.247730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:31.256255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-63434dcb-1eca-4424-84db-0c634cb0a087 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085636 Sep 06 12:21:31.256840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2279/4580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:31 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:32.280304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:32.280917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:32.287439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:32.287921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:32.288356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:32.289045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:32.289497 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:32.289990 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:32.352280 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:32.361937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1d340fbd-bdab-43f3-b265-5ee8567f2813 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086382 Sep 06 12:21:32.362703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2302/4581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:33.388484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:33.389083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:33.395558 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:33.396047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:33.396489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:33.397180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:33.397661 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:33.398100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:33.459460 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:33.468374 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9c0f348a-a83c-4631-967c-5e8018c36af5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084296 Sep 06 12:21:33.468944 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2280/4582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:34.491513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:34.492177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:34.498764 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:34.499244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:34.499756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:34.500367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:34.500822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:34.501238 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:34.574038 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:34.582627 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-59e5a234-71e6-4a57-85ae-d57413cd60ec tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.094988 Sep 06 12:21:34.583197 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2303/4583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:35.606816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:35.607365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:35.613879 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:35.614361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:35.614800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:35.615491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:35.615942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:35.616365 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:35.680384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:35.689303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3f691484-6241-405b-8bb2-c53087bdeb0f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087469 Sep 06 12:21:35.689915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2281/4584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:21:36.712375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:36.712989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:36.719732 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:36.720217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:36.720657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:36.721350 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:36.721846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:36.722277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:36.788542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:36.796838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c6a641fc-4b98-4a08-997f-f303a3daee51 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088337 Sep 06 12:21:36.797410 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2304/4585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:37.820337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:37.820946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:37.823816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:37.828972 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:37.829454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:37.829921 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:37.830606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:37.831056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:37.831475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:37.834211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=84 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:37.897759 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:37.906888 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bc675473-2ac4-4770-b49b-311c71d67de3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090453 Sep 06 12:21:37.907457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2282/4586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:38.930266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:38.931536 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:38.938376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:38.938867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:38.939348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:38.940075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:38.940530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:38.940963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:38.944893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=84 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:39.003021 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:39.011786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-afd95795-1d7b-4d24-bf48-cefcd8169d5f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085474 Sep 06 12:21:39.012364 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2305/4587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:40.036134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:40.036745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:40.047837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:40.048340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:40.048806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:40.049517 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:40.050019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:40.054905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:40.113535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:40.121904 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-98bcdc51-d7ac-46ab-a1de-75d95258f96a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089751 Sep 06 12:21:40.122477 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2283/4588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:41.145490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:41.146129 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:41.148418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:41.154431 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:41.154922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:41.155377 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:41.156063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:41.156525 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:41.156958 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:41.224275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:41.233066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-daa91cad-8023-487a-a676-e931b932dcb9 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091505 Sep 06 12:21:41.233638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2306/4589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:41 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:21:42.256345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:42.256949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:42.263787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:42.264259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:42.264692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:42.265379 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:42.265874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:42.266297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:42.327701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:42.335829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-442f46bb-1831-4ad5-aa62-5130d9d92a82 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083288 Sep 06 12:21:42.336403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2284/4590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:43.358621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:43.359274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:43.367024 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:43.367511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:43.367951 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:43.368714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:43.369179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:43.369639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:43.435513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:43.443784 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9989d965-8e36-4989-9230-cbb2f02bf116 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089477 Sep 06 12:21:43.444353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2307/4591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:44.469119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:44.469731 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:44.476855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:44.477342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:44.477813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:44.478512 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:44.478956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:44.479409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:44.542351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:44.550572 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-60258691-5d8c-48f3-90a5-2ac33f12d836 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085494 Sep 06 12:21:44.551141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2285/4592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:44 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:45.573853 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:45.574783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:45.581393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:45.581918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:45.582363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:45.583062 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:45.583528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:45.583952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:45.646468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:45.656143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90bade1e-011a-4080-97bc-7057bbd371c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086459 Sep 06 12:21:45.656714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2308/4593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:45 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:46.680047 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:46.680669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:46.687692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:46.688179 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:46.688619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:46.689324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:46.689817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:46.690248 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:46.753763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:46.762027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e1b4ff4b-0bc4-4813-880d-b936cd43f30c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085821 Sep 06 12:21:46.762600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2286/4594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:47.784822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:47.785437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:47.791852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:47.792582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:47.793015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:47.793717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:47.794171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:47.794590 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:47.856608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:47.864893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3673ea48-3382-4406-b408-1d96585b9db1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084018 Sep 06 12:21:47.865458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2309/4595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:47 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:48.889320 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:48.889980 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:48.896397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:48.896871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:48.897300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:48.898019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:48.898469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:48.898894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:48.960724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:48.969760 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1d8b28da-d247-44c7-a24d-5f220d276a15 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084887 Sep 06 12:21:48.970322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2287/4596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:48 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:49.992407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:49.993016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:49.999708 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:50.000189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:50.000629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:50.001313 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:50.001798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:50.002222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:50.067379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:50.075878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f3f9a9c2-86f4-4662-8edc-08bd6899013e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087340 Sep 06 12:21:50.076462 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2310/4597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:49 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:51.100358 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:51.100981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:51.107747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:51.108236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:51.108678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:51.109378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:51.109873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:51.110313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:51.171970 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:51.180133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c660ef96-b801-49b1-99c5-e980de7009e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084301 Sep 06 12:21:51.180689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2288/4598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:51 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:52.203449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:52.204073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:52.210811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:52.211296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:52.211742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:52.212489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:52.212893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:52.214033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:52.281799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:52.290492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5e8ff929-e406-42d3-ae65-dab596f43bb2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090929 Sep 06 12:21:52.291063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2311/4599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:52 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:53.314536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:53.315156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:53.321568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:53.322095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:53.322534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:53.324123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:53.324586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:53.325017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:53.389057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:53.397283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e32f7e23-7818-41d8-90d9-a093fbc7b10d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086786 Sep 06 12:21:53.397887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2289/4600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:53 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:54.421876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:54.423382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:54.430365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:54.430924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:54.431519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:54.432955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:54.433538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:54.434217 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:54.500096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:54.508443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0b15a4d8-3d5e-4ab2-910b-e5516c1ab4c1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091818 Sep 06 12:21:54.508943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2312/4601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:54 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:55.532880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:55.533398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:55.539767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:55.540250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:55.540688 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:55.541378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:55.541878 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:55.542309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:55.611845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:55.621751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-97f6a228-7083-45a2-992c-9209a5f11814 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.092335 Sep 06 12:21:55.622376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2290/4602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:55 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:56.644581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:56.645158 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:56.652757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:56.653248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:56.653710 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:56.654403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:56.654865 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:56.655282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:56.717041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:56.725196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d8ac89a5-f690-42ed-9c17-9a4a11f3e998 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084628 Sep 06 12:21:56.725785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2313/4603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:56 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:57.747853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:57.748473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:57.755259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:57.755749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:57.756191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:57.756883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:57.757343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:57.757815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:57.819628 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:57.828566 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1573814c-9ecf-4669-944e-0333aa502f86 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084659 Sep 06 12:21:57.829139 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2291/4604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:57 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:58.851922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:58.852564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:58.859057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:58.859535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:58.859965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:58.860644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:58.861094 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:58.861511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:58.927008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:21:58.935461 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f905cfa-eada-4607-a6d1-7be46a494b17 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087383 Sep 06 12:21:58.936036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2314/4605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:58 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:21:59.959385 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:21:59.959992 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:21:59.967700 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:59.968188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:59.968658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:21:59.969383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:21:59.970067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:21:59.970383 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:00.033391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:00.042304 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-76f04593-7205-4552-a1fb-a0da7e037202 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086237 Sep 06 12:22:00.042870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2292/4606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:21:59 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:01.065148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:01.072919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:01.074600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:01.075095 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:01.075537 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:01.076240 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:01.076696 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:01.077122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:01.141162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:01.149608 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4370eb14-53c3-4ced-98c7-8f35b807f889 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088473 Sep 06 12:22:01.150268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2315/4607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:01 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:02.173283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:02.173898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:02.180453 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:02.180947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:02.181390 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:02.183190 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:02.183655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:02.184086 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:02.246508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:02.254931 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9b7973b0-894c-4639-8286-c63e8cd9829c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085818 Sep 06 12:22:02.255501 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2293/4608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:02 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:03.279840 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:03.280456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:03.286966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:03.287450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:03.287893 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:03.288583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:03.289073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:03.289502 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:03.350684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:03.359059 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6efb04a5-6927-41c1-8470-fe5a7a0ee5b3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084187 Sep 06 12:22:03.359637 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2316/4609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:03 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:04.383089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:04.383783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:04.390981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:04.391469 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:04.391908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:04.392602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:04.393062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:04.393491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:04.458617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:04.466864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cc619ca3-ccc4-4431-9e09-fab62d3b13bc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087637 Sep 06 12:22:04.467441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2294/4610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:04 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:22:05.490106 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:05.490719 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:05.497268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:05.497785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:05.498232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:05.498922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:05.499383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:05.499808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:05.561594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:05.570664 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a4713309-9cc5-4afd-9169-960ade3f1bc0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084351 Sep 06 12:22:05.571400 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2317/4611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:05 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:06.597495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:06.598216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:06.605448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:06.605967 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:06.606407 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:06.607165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:06.607627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:06.608052 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:06.674115 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:06.682380 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba8305c6-8cd4-40ec-a5cb-71767ff48cbd tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089668 Sep 06 12:22:06.682960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2295/4612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:06 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:07.705580 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:07.706219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:07.712605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:07.713729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:07.714184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:07.714908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:07.715514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:07.716179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:07.786040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:07.794912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b1570f69-02f2-44a2-ab66-cd985201c8d8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093179 Sep 06 12:22:07.795498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2318/4613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:07 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:08.819216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:08.819792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:08.822267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:08.829036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:08.829534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:08.830012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:08.830726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:08.831219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:08.831674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:08.834570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=84 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:08.900525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:08.910741 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92aaa8b5-9e5c-4a70-a942-db077a4f63ba tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.095674 Sep 06 12:22:08.911525 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2296/4614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:08 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:09.934288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:09.934900 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:09.941292 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:09.941812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:09.942244 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:09.942927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:09.943372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:09.943790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:09.948177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=84 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:10.006198 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:10.015733 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aa0792c2-91ac-4991-a6b1-4b69d75c4ab2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085911 Sep 06 12:22:10.016318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2319/4615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:09 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:11.040105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:11.040718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:11.047281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:11.047776 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:11.048220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:11.048922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:11.049382 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:11.049844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:11.114862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:11.124208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-acd1d494-cbb5-48ea-bdb6-08892a9a1e3d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088113 Sep 06 12:22:11.124787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2297/4616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:11 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:12.150200 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:12.151546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:12.154593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:12.160541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:12.161033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:12.161480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:12.162298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:12.162758 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:12.163191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:12.229877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:12.238245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c0bff96c-a0db-4a8e-baf6-97cbeba2ab0d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091999 Sep 06 12:22:12.238877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2320/4617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:12 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:22:13.262090 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:13.262809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:13.269404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.269926 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.270363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.271057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:13.271508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:13.271930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:13.338993 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:13.347392 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-81b6e804-a06e-42d0-9110-43df0ef6f946 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089522 Sep 06 12:22:13.347960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2298/4618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:13 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:14.371862 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:14.372471 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:14.379302 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:14.379788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:14.380222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:14.380913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:14.381363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:14.381834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:14.446248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:14.455356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99e7009f-9a7e-4d13-b703-31eff9b7978c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087944 Sep 06 12:22:14.455931 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2321/4619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:14 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:15.478503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:15.479122 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:15.485615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:15.486140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:15.486585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:15.487291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:15.487747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:15.488176 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:15.550960 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:15.559685 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a02fd8b-b1f7-4e92-a16c-5d859e5be6d1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085176 Sep 06 12:22:15.560260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2299/4620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:15 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:16.583283 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:16.583821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:16.590688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:16.591184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:16.592235 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:16.592337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:16.592849 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:16.593259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:16.661273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:16.670236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-11ffd094-de26-450f-8de4-5da0104eba85 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090996 Sep 06 12:22:16.670811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2322/4621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:16 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:17.694185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:17.694797 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:17.701951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:17.702433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:17.702864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:17.703548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:17.703996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:17.704415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:17.766282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:17.774503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-06fa6886-6bd7-4456-a1ba-3f4a65370ca1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084169 Sep 06 12:22:17.775083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2300/4622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:17 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:18.798277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:18.798895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:18.805933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:18.806426 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:18.806863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:18.807556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:18.808013 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:18.808445 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:18.869152 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:18.877379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a31e6bd7-b07b-499f-9ae1-ad46b909239b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.083131 Sep 06 12:22:18.878122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2323/4623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:18 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:19.901123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:19.901758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:19.908658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:19.909140 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:19.909574 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:19.910293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:19.910744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:19.911164 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:19.973029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:19.982709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-27898d46-33ef-4c8e-b89d-4376c122a8d2 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085542 Sep 06 12:22:19.983301 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2301/4624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:19 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:21.006159 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:21.006782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:21.013952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:21.014444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:21.014892 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:21.015586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:21.016044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:21.016473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:21.078203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:21.086325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-aa7208ac-53b1-4916-b3c7-b5f25a416ced tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084093 Sep 06 12:22:21.086887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2324/4625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:21 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:22.109281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:22.110178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:22.116614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:22.117182 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:22.117975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:22.119330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:22.119818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:22.120327 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:22.189663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:22.198890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-850bf778-2418-40b2-a751-ee4a3709e1d3 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.093814 Sep 06 12:22:22.199549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2302/4626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:22 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:23.223008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:23.223618 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:23.230124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:23.230604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:23.231121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:23.231722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:23.232174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:23.232692 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:23.296335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:23.304546 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-60ebf218-a3dc-445f-8c6d-73ecde485b60 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085623 Sep 06 12:22:23.305109 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2325/4627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:23 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:24.329082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:24.329720 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:24.336216 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:24.336704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:24.337144 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:24.337869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:24.338330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:24.338770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:24.399798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:24.408268 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4f98a5c0-712f-4f63-94e2-87e693d17488 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.082966 Sep 06 12:22:24.408851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2303/4628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:24 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:25.432236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:25.432878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:25.439307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:25.439795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:25.440232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:25.440924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:25.441383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:25.441864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:25.505943 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:25.514232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f6212063-899e-4abf-8045-ddd101018062 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085899 Sep 06 12:22:25.514804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2326/4629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:25 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:26.538399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:26.538948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:26.546719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:26.547199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:26.547634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:26.548328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:26.548784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:26.549210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:26.615373 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:26.624252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7e2da9ac-52c2-4f6d-925c-7acdb29155cb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089766 Sep 06 12:22:26.624829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2304/4630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:26 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:27.646703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:27.647256 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:27.654285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:27.654775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:27.655305 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:27.655908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:27.656374 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:27.656802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:27.718411 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:27.726702 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7f037323-abda-43e5-a595-1ee3b70acc4f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084136 Sep 06 12:22:27.727284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2327/4631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:27 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:22:28.751101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:28.751746 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:28.758208 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:28.758695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:28.759138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:28.759841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:28.760293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:28.760734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:28.827917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:28.836451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a420e770-a310-4ec4-8c3e-db449bedaa00 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089290 Sep 06 12:22:28.837022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2305/4632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:28 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:29.859796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:29.860415 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:29.866979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:29.867468 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:29.867905 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:29.869343 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:29.869948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:29.870384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:29.933220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:29.941480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0ed45e25-d618-480d-828f-b24c0d499afb tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085582 Sep 06 12:22:29.942087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2328/4633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:29 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:30.966452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:30.967066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:30.973523 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:30.974040 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:30.974481 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:30.975168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:30.975627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:30.976048 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:31.041957 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:31.050194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8e2ee6e4-09ed-433d-8b79-70f91b3e7665 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.088860 Sep 06 12:22:31.050771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2306/4634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:30 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:32.073269 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:32.073924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:32.080396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:32.080883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:32.081794 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:32.082162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:32.082625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:32.083055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:32.146560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:32.155731 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3972f77b-f907-4275-8479-2c04df111104 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086406 Sep 06 12:22:32.156304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2329/4635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:32 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:33.180534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:33.181149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:33.188337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:33.188823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:33.189261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:33.189982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:33.190440 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:33.190870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:33.253149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:33.262070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6ab3e5ac-efc5-4a9b-b090-2212a1876221 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.085338 Sep 06 12:22:33.262653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2307/4636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:33 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:34.285450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:34.286092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:34.294480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:34.294946 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:34.295384 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:34.296099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:34.296564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:34.297616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:34.363685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:34.372698 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c6657f6c-4968-4dd4-9945-b71a02711a12 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091098 Sep 06 12:22:34.373268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2330/4637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:34 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:35.394708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:35.395323 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:35.402679 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:35.403172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:35.403613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:35.404313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:35.404767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:35.405191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:35.467229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:35.475318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b59cadf8-6fc9-4272-b8e5-b2051daec9e7 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.084427 Sep 06 12:22:35.475882 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2308/4638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:35 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:36.500164 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:36.500835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:36.507488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:36.507989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:36.508432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:36.509148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:36.509611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:36.510925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:36.575660 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:36.583847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ce040adb-50e0-4cae-8331-e9c21c4e6eb0 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087655 Sep 06 12:22:36.584409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2331/4639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:36 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:37.606937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:37.607486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:37.613815 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:37.614297 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:37.614726 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:37.615409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:37.615857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:37.616280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:37.680842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:37.689372 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-39e163a7-639b-48f6-ab08-8d76c35e66cc tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.086529 Sep 06 12:22:37.689987 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2309/4640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:37 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:38.713213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:38.713887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:38.720542 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:38.721034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:38.721478 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:38.722222 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:38.722684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:38.723108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:38.789124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:38.800182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-20d0de48-82a0-4c5a-b3f3-e2d1b0085318 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091003 Sep 06 12:22:38.800766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2332/4641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:38 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:39.824883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:39.825489 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:39.827536 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:39.832930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:39.833415 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:39.833886 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:39.834578 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:39.835031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:39.835458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:39.838307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=84 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:39.902107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:39.910586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e30d157-185c-4a12-944b-829eb93d041f tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.089725 Sep 06 12:22:39.911156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2310/4642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:39 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:40.934042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:40.934726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:40.941422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:40.941966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:40.942407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:40.943165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:40.943629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:40.944058 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:40.947971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=84 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:41.012077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:41.020320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3ae4536c-0ef2-4376-9584-0a0b38730744 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.090724 Sep 06 12:22:41.020895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2333/4643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:40 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:42.044438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:42.044996 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:42.051639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:42.052157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:42.052591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:42.053282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:42.053770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:42.054193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:42.117847 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:42.126864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-45199af8-f1f4-4b8f-ba9d-86f478cfda7c tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.087016 Sep 06 12:22:42.127450 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2311/4644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:42 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:43.150116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:43.150668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:43.153831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=28 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:43.159372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:43.159882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:43.160326 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:43.161051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:43.161482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:43.161933 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:43.227677 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:43.237754 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-90ba97ef-f9c7-41b1-9512-a667e6d7e0ad tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 200 len: 1368 microversion: 2.1 time: 0.091529 Sep 06 12:22:43.238344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2334/4645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:43 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:43.263633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f6fc3172-77d2-46a4-8a01-836298954158 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '.version_select at 0x7f97f85fadc0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:43.289414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f6fc3172-77d2-46a4-8a01-836298954158 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299797793" status: 202 len: 0 microversion: 2.1 time: 0.030381 Sep 06 12:22:43.290051 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2312/4646] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 6 12:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299797793 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:22:44.219285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-078ced4a-6472-41c3-abbb-a7bb49cab884 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: .version_select at 0x7f97f4ffe040>, body: {"keypair": {"name": "tempest-keypair-1274975530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUPD0mMuv2hEUqxgksH8Yi+haLUJVWV1sSdM4MGUuQimBKi8qtDuDRU6Ae6ohJUzuSk2dsCIFAQmnUc9trtBuM/Pm4wWSeqPA+D0Lg4hLEBiFTy8pCRuqlJ4id+VimDMQ=="}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:44.235888 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-078ced4a-6472-41c3-abbb-a7bb49cab884 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for project 2be7be1a9bb1487aac2c32871398119e. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:22:44.239739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-078ced4a-6472-41c3-abbb-a7bb49cab884 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for user ccbb0b2070694235bf87a7b9a0c84dbe and project 2be7be1a9bb1487aac2c32871398119e. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:22:44.264337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-078ced4a-6472-41c3-abbb-a7bb49cab884 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048913 Sep 06 12:22:44.264950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2335/4647] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 12:22:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:45.523821 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1944545908", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1984278-bf78-4be1-a7c3-c6735a1ccdd2"}], "security_groups": [{"name": "tempest-securitygroup--207755680"}], "key_name": "tempest-keypair-1274975530", "user_data": "}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:45.629378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] validate_networks() for [('c1984278-bf78-4be1-a7c3-c6735a1ccdd2', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:22:46.059716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:22:46.060191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:22:46.060667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:22:46.061076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:22:46.061486 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:22:46.070337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:46.070819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:46.071254 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:46.071981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:46.072436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:46.072863 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:46.090018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for project 2be7be1a9bb1487aac2c32871398119e. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:22:46.093973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Getting quotas for user ccbb0b2070694235bf87a7b9a0c84dbe and project 2be7be1a9bb1487aac2c32871398119e. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:22:46.104950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:22:46.107285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:22:46.156561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b8df2930-4472-4555-83f8-ce6ae2afec21 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637070 Sep 06 12:22:46.157257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2313/4648] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 12:22:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:22:46.170432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c70e20e8-f4d9-453b-8dd3-a04cc3776499 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:46.171055 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c70e20e8-f4d9-453b-8dd3-a04cc3776499 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:46.226791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c70e20e8-f4d9-453b-8dd3-a04cc3776499 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:46.234482 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c70e20e8-f4d9-453b-8dd3-a04cc3776499 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1238 microversion: 2.1 time: 0.069876 Sep 06 12:22:46.235068 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2336/4649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:46 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:47.257590 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:47.258263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:47.265337 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:47.265872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:47.266312 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:47.267019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:47.267474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:47.267905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:47.330799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:47.338376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b6223ef7-c9ea-4eaf-a1ea-cc80e2b09bff tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1290 microversion: 2.1 time: 0.085538 Sep 06 12:22:47.338975 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2314/4650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:47 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:48.362008 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:48.362630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:48.369420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:48.369987 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:48.371065 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:48.371786 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:48.372249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:48.372680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:48.537476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:48.545454 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-58350719-c305-48ea-8c0c-c5e4af409eb8 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1296 microversion: 2.1 time: 0.187466 Sep 06 12:22:48.546072 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2337/4651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:48 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1296 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:49.477361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-48c94dbf-b0c7-4bd3-ba51-ec5474b83cb0 req-0abba76d-72a1-4fdb-b7fe-133b9f0773fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50930d4-c6df-4994-934e-cdf1807fe0c0", "tag": "b9e31fca-87e5-4293-9aec-60df67f7dd46"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:49.489472 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-48c94dbf-b0c7-4bd3-ba51-ec5474b83cb0 req-0abba76d-72a1-4fdb-b7fe-133b9f0773fa service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:49.490000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-48c94dbf-b0c7-4bd3-ba51-ec5474b83cb0 req-0abba76d-72a1-4fdb-b7fe-133b9f0773fa service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:49.490431 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-48c94dbf-b0c7-4bd3-ba51-ec5474b83cb0 req-0abba76d-72a1-4fdb-b7fe-133b9f0773fa service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:49.502763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-48c94dbf-b0c7-4bd3-ba51-ec5474b83cb0 req-0abba76d-72a1-4fdb-b7fe-133b9f0773fa service nova] Creating event network-changed:b9e31fca-87e5-4293-9aec-60df67f7dd46 for instance b50930d4-c6df-4994-934e-cdf1807fe0c0 on hv-cinder-85604 Sep 06 12:22:49.508349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-48c94dbf-b0c7-4bd3-ba51-ec5474b83cb0 req-0abba76d-72a1-4fdb-b7fe-133b9f0773fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097761 Sep 06 12:22:49.508953 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2315/4652] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:49.568654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:49.569272 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:49.576675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:49.577161 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:49.577597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:49.578331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:49.578785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:49.579207 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:49.779530 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:49.787439 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3c979b93-656a-4577-b4ab-45004e043454 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.222672 Sep 06 12:22:49.788018 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2338/4653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:49 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:22:50.813016 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:50.813744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:50.820522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:50.821001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:50.821430 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:50.822147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:50.822597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:50.823019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:50.954117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:50.961579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a1fe3545-757b-4d50-9bc5-57353932926e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.152776 Sep 06 12:22:50.962175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2316/4654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:50 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:51.984781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:51.985392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:51.991883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:51.992363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:51.992798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:51.993490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:51.993977 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:51.994403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:52.124976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:52.132611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7fa3ad4e-b382-4bcb-a943-49817a2f5a63 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.151777 Sep 06 12:22:52.133177 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2339/4655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:51 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:53.156417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:53.156988 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:53.163386 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:53.163866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:53.164296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:53.164978 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:53.165428 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:53.165871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:53.300696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:53.308330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5b51b65b-377a-4d46-8a2b-48e1529daeef tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.156125 Sep 06 12:22:53.308903 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2317/4656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:53 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:54.331574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:54.332194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:54.338886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:54.339373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:54.339817 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:54.340513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:54.340971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:54.341399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:54.480908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:54.489099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-956a7f35-8261-4fb6-924d-19873725545b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.161498 Sep 06 12:22:54.489693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2340/4657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:54 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:54.879826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-d6d73a92-5982-4b20-9289-1beaab0c5e73 req-9ee15a6a-bde9-46be-a732-37120b4e57ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50930d4-c6df-4994-934e-cdf1807fe0c0", "name": "network-vif-plugged", "status": "completed", "tag": "b9e31fca-87e5-4293-9aec-60df67f7dd46"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:54.889632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-d6d73a92-5982-4b20-9289-1beaab0c5e73 req-9ee15a6a-bde9-46be-a732-37120b4e57ad service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:54.890149 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-d6d73a92-5982-4b20-9289-1beaab0c5e73 req-9ee15a6a-bde9-46be-a732-37120b4e57ad service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:54.890615 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-d6d73a92-5982-4b20-9289-1beaab0c5e73 req-9ee15a6a-bde9-46be-a732-37120b4e57ad service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:54.901989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-d6d73a92-5982-4b20-9289-1beaab0c5e73 req-9ee15a6a-bde9-46be-a732-37120b4e57ad service nova] Creating event network-vif-plugged:b9e31fca-87e5-4293-9aec-60df67f7dd46 for instance b50930d4-c6df-4994-934e-cdf1807fe0c0 on hv-cinder-85604 Sep 06 12:22:54.907562 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-d6d73a92-5982-4b20-9289-1beaab0c5e73 req-9ee15a6a-bde9-46be-a732-37120b4e57ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091380 Sep 06 12:22:54.908098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2318/4658] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:55.513267 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:55.513846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:55.520658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:55.521147 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:55.521592 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:55.522337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:55.522797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:55.523228 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:55.657609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:55.665365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0771fce5-af2c-4606-8c3f-76e98873fe16 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.156844 Sep 06 12:22:55.665971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2341/4659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:55 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:56.685260 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:56.686037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=6 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:56.690189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:56.690885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:56.698539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:56.698762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:56.699197 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:56.699868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:56.700317 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:56.700735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:56.829340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:56.837041 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7f139c92-31bb-4472-9ea1-d8e5c8f9f432 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1363 microversion: 2.1 time: 0.153143 Sep 06 12:22:56.837619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2319/4660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:56 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:57.861091 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:57.861769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:57.863685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=6 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:57.869146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:57.869738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:57.870344 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:57.871047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:57.871510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:57.871937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:58.004120 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:22:58.011837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ecc10b1c-7843-44c2-a5d6-c4f2cdcc5525 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1548 microversion: 2.1 time: 0.154851 Sep 06 12:22:58.012420 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2342/4661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:22:57 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:22:58.034948 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:22:58.035455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:22:58.042534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:58.043029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:58.043471 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:58.044166 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:58.044627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:58.045061 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:58.122012 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-3d64f225-48e5-425b-91f6-1e88e6a6d2fe tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090973 Sep 06 12:22:58.122646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2320/4662] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 12:22:58 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:22:59.118379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-b80757df-829c-40a7-ad0a-2f58d8e21aaa req-957db435-8a4a-484d-90a1-dd3a870aaaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50930d4-c6df-4994-934e-cdf1807fe0c0", "tag": "b9e31fca-87e5-4293-9aec-60df67f7dd46"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:22:59.128805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-b80757df-829c-40a7-ad0a-2f58d8e21aaa req-957db435-8a4a-484d-90a1-dd3a870aaaef service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:22:59.129386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-b80757df-829c-40a7-ad0a-2f58d8e21aaa req-957db435-8a4a-484d-90a1-dd3a870aaaef service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:22:59.129919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-b80757df-829c-40a7-ad0a-2f58d8e21aaa req-957db435-8a4a-484d-90a1-dd3a870aaaef service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:22:59.141427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-b80757df-829c-40a7-ad0a-2f58d8e21aaa req-957db435-8a4a-484d-90a1-dd3a870aaaef service nova] Creating event network-changed:b9e31fca-87e5-4293-9aec-60df67f7dd46 for instance b50930d4-c6df-4994-934e-cdf1807fe0c0 on hv-cinder-85604 Sep 06 12:22:59.146685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-b80757df-829c-40a7-ad0a-2f58d8e21aaa req-957db435-8a4a-484d-90a1-dd3a870aaaef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090997 Sep 06 12:22:59.147428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2343/4663] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:24:14.040324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:24:14.040908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:24:14.041588 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=45 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:24:14.047706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:24:14.048203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:24:14.056188 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:24:14.056718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:24:14.057162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:24:14.058185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:24:14.058650 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:24:14.059155 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:24:14.085670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ab1b5e1b-cb29-485b-9672-3c5aa0aa998e tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/ips" status: 200 len: 145 microversion: 2.1 time: 0.046984 Sep 06 12:24:14.086269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2321/4664] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:24:14 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:04.199981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c439015-29a7-4d5a-9f87-ef7693d37ebc] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:25:04.200621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:04.201355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=49 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:04.202600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:25:04.202740 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:25:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 (ip 10.222.0.18) !!! Sep 06 12:25:04.215220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:04.215819 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:04.230327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.230327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.230327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.230327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.230656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.230656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.247157 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:04.247705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:04.254670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:25:04.255063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:25:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 (ip 10.222.0.18) !!! Sep 06 12:25:04.256198 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:04.257076 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:04.258437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:25:04.259946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.261792 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.262465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.263923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.264751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.265255 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.292199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56536. Sep 06 12:25:04.297761 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:25:04.346681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-95f996d4-452f-455f-9c64-e5d21580f0a9 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 204 len: 0 microversion: 2.20 time: 0.148355 Sep 06 12:25:04.348559 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2344/4665] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 6 12:25:04 2022] DELETE /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 12:25:04.357942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:04.359070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:04.365680 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.366172 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.366596 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.367293 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.367746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.368162 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.393851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-12959877-df58-48ef-a250-27d7c9371ac1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 204 len: 0 microversion: 2.1 time: 0.150446 Sep 06 12:25:04.394495 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2322/4666] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:25:04 2022] DELETE /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:25:04.403804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:04.404638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:04.412324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.412966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.413763 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.414641 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:04.415200 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:04.415798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:04.574509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:04.583039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c104f42a-b558-45e0-a0be-5f0740cefb3d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1682 microversion: 2.1 time: 0.183750 Sep 06 12:25:04.584774 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2323/4667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:04 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:25:04.588744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:04.601163 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:04.602799 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:04.604103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2e8b673d-187f-4445-a2c3-25decfa0d7b4 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1721 microversion: 2.20 time: 0.251180 Sep 06 12:25:04.604775 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2345/4668] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:25:04 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:25:05.609130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:05.609693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:05.616121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:05.616604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:05.617044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:05.617772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:05.618236 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:05.618668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:05.638715 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c439015-29a7-4d5a-9f87-ef7693d37ebc] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56556. Sep 06 12:25:05.643220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:05.643911 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:05.651398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:05.652133 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:05.652836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:05.653538 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:05.654026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:05.654456 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:05.759036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:05.767196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8fb69afc-65ad-4cf4-bb4d-d178551bad86 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1682 microversion: 2.1 time: 0.162036 Sep 06 12:25:05.767773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2324/4669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:05 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:25:05.867871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:05.876232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:05.878117 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:05.879346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f81a7ff-c58c-46c8-b539-5b6466bd8152 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1721 microversion: 2.20 time: 0.251421 Sep 06 12:25:05.879917 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2346/4670] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:25:05 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 12:25:06.622711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-2fe0af14-89e1-4c0f-ac1e-d7776c2810ab req-b4d04719-32d1-44e5-8070-780df475c395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3e3706-8f24-400d-889c-3cd946e70e71", "name": "network-vif-deleted", "tag": "2dd592a8-e422-4f7e-8c4d-81308f6c2b0f"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:06.639084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-2fe0af14-89e1-4c0f-ac1e-d7776c2810ab req-b4d04719-32d1-44e5-8070-780df475c395 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:06.639084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-2fe0af14-89e1-4c0f-ac1e-d7776c2810ab req-b4d04719-32d1-44e5-8070-780df475c395 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:06.639084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-2fe0af14-89e1-4c0f-ac1e-d7776c2810ab req-b4d04719-32d1-44e5-8070-780df475c395 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:06.670874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-2fe0af14-89e1-4c0f-ac1e-d7776c2810ab req-b4d04719-32d1-44e5-8070-780df475c395 service nova] Creating event network-vif-deleted:2dd592a8-e422-4f7e-8c4d-81308f6c2b0f for instance 1f3e3706-8f24-400d-889c-3cd946e70e71 on hv-cinder-85604 Sep 06 12:25:06.681014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-2fe0af14-89e1-4c0f-ac1e-d7776c2810ab req-b4d04719-32d1-44e5-8070-780df475c395 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061929 Sep 06 12:25:06.682295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2325/4671] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:06.791663 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:06.793053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:06.799728 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:06.800381 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:06.801014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:06.801920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:06.802685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:06.803277 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:06.911063 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:06.917470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:06.919779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:06.931782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3f3b5fa0-0c6f-4431-829d-34e288eee225 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1614 microversion: 2.1 time: 0.144654 Sep 06 12:25:06.932763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2347/4672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:06 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:06.937509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:06.938083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:06.939547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:06.941610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:06.942339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:06.943514 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:06.994695 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:06.995185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:06.995865 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:06.996485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lazy-loading 'fault' on Instance uuid 1f3e3706-8f24-400d-889c-3cd946e70e71 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:25:07.067585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:07.077473 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:07.078973 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e235718ad1da42ebb209fb4b13626ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a896d72b5b00477d855131345711c748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:07.080160 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-18b569ef-6475-409e-8544-908f354dcf7e tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 200 len: 1370 microversion: 2.20 time: 0.179336 Sep 06 12:25:07.080711 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2326/4673] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:25:06 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 12:25:07.210815 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-5b1e52e4-4369-486e-a175-05e6d7d00f84 req-f6f13061-21b9-4577-a15b-3f4b34ce644a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71ac230-7b8b-496d-951a-748db65f4839", "name": "network-vif-deleted", "tag": "9720560a-3549-45ec-b606-0f6722934e0a"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:07.231842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5b1e52e4-4369-486e-a175-05e6d7d00f84 req-f6f13061-21b9-4577-a15b-3f4b34ce644a service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:07.234824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5b1e52e4-4369-486e-a175-05e6d7d00f84 req-f6f13061-21b9-4577-a15b-3f4b34ce644a service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:07.235366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-5b1e52e4-4369-486e-a175-05e6d7d00f84 req-f6f13061-21b9-4577-a15b-3f4b34ce644a service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:07.257014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-5b1e52e4-4369-486e-a175-05e6d7d00f84 req-f6f13061-21b9-4577-a15b-3f4b34ce644a service nova] Creating event network-vif-deleted:9720560a-3549-45ec-b606-0f6722934e0a for instance e71ac230-7b8b-496d-951a-748db65f4839 on hv-cinder-85604 Sep 06 12:25:07.263995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-5b1e52e4-4369-486e-a175-05e6d7d00f84 req-f6f13061-21b9-4577-a15b-3f4b34ce644a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060008 Sep 06 12:25:07.265295 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2348/4674] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:07.956837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:07.957556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:07.966163 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:07.966655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:07.967096 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:07.967859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:07.968400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:07.968831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:08.004470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:08.004964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:08.005950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:08.006596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'fault' on Instance uuid e71ac230-7b8b-496d-951a-748db65f4839 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:25:08.049709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:08.058300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-22df81e3-e945-4f79-ba97-df1aa55168d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 200 len: 1332 microversion: 2.1 time: 0.105572 Sep 06 12:25:08.059053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2327/4675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:07 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:08.111614 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:08.112328 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:08.120327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:08.120823 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:08.121261 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:08.122044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:08.122506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:08.122935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:08.137242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] HTTP exception thrown: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Request method failure captured: Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 HTTP/1.1 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzPv0WtLeLqEDxmjmkzHLSMUmkE09JJ1VVVwZVSBDR9kNuTQ3_WMYwe7dEsotKOdoT2epiGF-jLwJDj0b5SJnHlS5ywBsZT7K8YyhLJf1gydCpM4pXSsnIhwlaGOrAwwhBcVVO_D1t0iNa3UsfRMSaDwZgHxxpOXhkThFjbqudFGNcI Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: a896d72b5b00477d855131345711c748 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:25:08.139003 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a896d72b5b00477d855131345711c748"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a896d72b5b00477d855131345711c748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}] Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: a896d72b5b00477d855131345711c748 Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e235718ad1da42ebb209fb4b13626ff1 Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:25:08.140588 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '1f3e3706-8f24-400d-889c-3cd946e70e71'} Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:25:08.141424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:25:08.142667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:08.143723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Returning 404 to user: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:25:08.143723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-fe4deb68-1015-414f-86f1-82785e8f67be tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 404 len: 111 microversion: 2.20 time: 0.033893 Sep 06 12:25:08.143723 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2349/4676] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:25:08 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:25:08.149883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-54fc0cd8-035c-4ea7-aec1-30ccac6881c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '.version_select at 0x7f97f85faaf0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:08.174645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-54fc0cd8-035c-4ea7-aec1-30ccac6881c0 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665078048" status: 204 len: 0 microversion: 2.20 time: 0.028749 Sep 06 12:25:08.175551 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2328/4677] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Sep 6 12:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665078048 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 12:25:09.082087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:09.082626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:09.089155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:09.089658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:09.090108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:09.090798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:09.091263 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:09.091688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:09.105889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 HTTP/1.1 Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:25:09.107472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:25:09.108944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'e71ac230-7b8b-496d-951a-748db65f4839'} Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:25:09.109899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:25:09.111193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:25:09.112842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:25:09.112842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d5528836-72bf-4082-9e26-913ae38fec6f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 404 len: 111 microversion: 2.1 time: 0.030731 Sep 06 12:25:09.112842 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2350/4678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:09 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:25:09.118417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d43bb8b0-a4c8-4e5d-a14b-5fc452c7484b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '.version_select at 0x7f97f4f96ee0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:09.137177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d43bb8b0-a4c8-4e5d-a14b-5fc452c7484b tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489442040" status: 202 len: 0 microversion: 2.1 time: 0.023328 Sep 06 12:25:09.137771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2329/4679] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 6 12:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489442040 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:25:10.050289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e120e77a-a681-4732-a79a-5c4cd531714d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: .version_select at 0x7f97f4fbe4c0>, body: {"keypair": {"name": "tempest-keypair-124404368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrMLJDd91IFLwwssQB5Zce755HbC+YFTGs8e5LbvcEp8NrAV1oIhTyD3h9N8Ingggv8JX4x0MivPablTgzwHvERlwNYWGK6VH5MSfbPRnkaPyhP2wuc5d9QsTCYJs9NRw=="}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:10.071529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-e120e77a-a681-4732-a79a-5c4cd531714d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:25:10.075532 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-e120e77a-a681-4732-a79a-5c4cd531714d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:25:10.099422 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e120e77a-a681-4732-a79a-5c4cd531714d tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052953 Sep 06 12:25:10.100025 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2351/4680] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 12:25:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:11.343922 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1642492576", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cda860d2-2fe0-49d5-8510-1c9e43ecbe57"}], "security_groups": [{"name": "tempest-securitygroup--62341841"}], "key_name": "tempest-keypair-124404368", "user_data": "}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:11.450143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] validate_networks() for [('cda860d2-2fe0-49d5-8510-1c9e43ecbe57', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:25:11.825128 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:25:11.825563 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:25:11.826069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:25:11.826480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:25:11.826897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:25:11.836218 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:11.836697 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:11.837132 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:11.837894 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:11.838397 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:11.838828 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:11.855784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:25:11.859734 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Getting quotas for user e05967546ef245d2b88874f6cf3f84fd and project eb4aab6e4d8f4582a2538ccd0004046c. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:25:11.870729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:25:11.873006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:25:11.921038 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-da90008a-88d4-4394-856c-7ffedc9c6aad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.581882 Sep 06 12:25:11.921890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2330/4681] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 12:25:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:25:11.933379 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dde60e66-526f-4032-bf83-5d317541dfb0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:11.934616 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-dde60e66-526f-4032-bf83-5d317541dfb0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:11.993851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-dde60e66-526f-4032-bf83-5d317541dfb0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:12.000811 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dde60e66-526f-4032-bf83-5d317541dfb0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1241 microversion: 2.1 time: 0.071847 Sep 06 12:25:12.001383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2352/4682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:11 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:13.025276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:13.025914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:13.032698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:13.033220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:13.033825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:13.034552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:13.035098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:13.035637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:13.098290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:13.107893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bafe700b-b94d-49bd-a275-e636a7397220 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1293 microversion: 2.1 time: 0.087415 Sep 06 12:25:13.108507 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2331/4683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:13 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:14.131443 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:14.132737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:14.140348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:14.140750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:14.141191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:14.141918 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:14.142376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:14.142805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:14.289335 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:14.297714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5e9003cb-b799-42c4-9a16-2faafbb567d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.170608 Sep 06 12:25:14.298290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2353/4684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:14 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:14.813292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-1032cb36-8872-451d-9c63-fd2e6f49a3e4 req-651e2a30-ee62-4688-b8ef-1b8bacc1741d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea08004-c8a9-44dc-a50a-0bede7230496", "tag": "51ff3577-65dc-4b72-9d1b-8937a3c7a985"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:14.824829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-1032cb36-8872-451d-9c63-fd2e6f49a3e4 req-651e2a30-ee62-4688-b8ef-1b8bacc1741d service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:14.825340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-1032cb36-8872-451d-9c63-fd2e6f49a3e4 req-651e2a30-ee62-4688-b8ef-1b8bacc1741d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:14.825891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-1032cb36-8872-451d-9c63-fd2e6f49a3e4 req-651e2a30-ee62-4688-b8ef-1b8bacc1741d service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:14.838062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-1032cb36-8872-451d-9c63-fd2e6f49a3e4 req-651e2a30-ee62-4688-b8ef-1b8bacc1741d service nova] Creating event network-changed:51ff3577-65dc-4b72-9d1b-8937a3c7a985 for instance 6ea08004-c8a9-44dc-a50a-0bede7230496 on hv-cinder-85604 Sep 06 12:25:14.843242 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-1032cb36-8872-451d-9c63-fd2e6f49a3e4 req-651e2a30-ee62-4688-b8ef-1b8bacc1741d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033642 Sep 06 12:25:14.844029 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2332/4685] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:15.320781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:15.321383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:15.330169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:15.330675 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:15.331112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:15.332254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:15.332706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:15.333123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:15.467687 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:15.481224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-45d8f494-d49d-4a33-894f-d4afd38e7935 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.164488 Sep 06 12:25:15.481886 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2354/4686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:15 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:16.505608 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:16.506281 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:16.513546 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:16.514097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:16.514539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:16.515237 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:16.515698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:16.516127 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:16.658107 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:16.666285 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5317ec34-1edb-4b46-835f-44b5afc1a724 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.165286 Sep 06 12:25:16.666874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2333/4687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:16 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:17.689143 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:17.689798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:17.696876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:17.697361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:17.697837 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:17.698544 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:17.699004 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:17.699467 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:17.836205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:17.843883 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-27d0c854-dba9-4229-bfc0-18dbea8b37ad tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.158741 Sep 06 12:25:17.844458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2355/4688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:17 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:18.866617 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:18.867167 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:18.873723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:18.874210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:18.874649 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:18.875342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:18.875801 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:18.876231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:19.009042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:19.016714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-759b968d-2d31-440e-9755-2558afb4f6b0 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.154712 Sep 06 12:25:19.017283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2334/4689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:18 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:20.040187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:20.040812 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:20.047693 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:20.048186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:20.048630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:20.049336 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:20.049949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:20.050282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:20.185189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:20.194444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4be7098a-e3cb-4ca9-9f7b-545ea3657626 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.158626 Sep 06 12:25:20.195026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2356/4690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:20 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:21.217231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:21.217869 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:21.224864 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:21.225346 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:21.225817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:21.226508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:21.226956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:21.227377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:21.363195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:21.371840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f4007fbe-8e16-49cc-b1a2-58acb6707be6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.158378 Sep 06 12:25:21.372540 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2335/4691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:21 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:21.459805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-fdb92785-df11-4bcc-a6e5-272144eb1e55 req-e8df951c-8056-48de-adf4-4b69690cc1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea08004-c8a9-44dc-a50a-0bede7230496", "name": "network-vif-plugged", "status": "completed", "tag": "51ff3577-65dc-4b72-9d1b-8937a3c7a985"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:21.470251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-fdb92785-df11-4bcc-a6e5-272144eb1e55 req-e8df951c-8056-48de-adf4-4b69690cc1ef service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:21.470756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-fdb92785-df11-4bcc-a6e5-272144eb1e55 req-e8df951c-8056-48de-adf4-4b69690cc1ef service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:21.471191 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-fdb92785-df11-4bcc-a6e5-272144eb1e55 req-e8df951c-8056-48de-adf4-4b69690cc1ef service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:21.483077 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-fdb92785-df11-4bcc-a6e5-272144eb1e55 req-e8df951c-8056-48de-adf4-4b69690cc1ef service nova] Creating event network-vif-plugged:51ff3577-65dc-4b72-9d1b-8937a3c7a985 for instance 6ea08004-c8a9-44dc-a50a-0bede7230496 on hv-cinder-85604 Sep 06 12:25:21.488607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-fdb92785-df11-4bcc-a6e5-272144eb1e55 req-e8df951c-8056-48de-adf4-4b69690cc1ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Sep 06 12:25:21.489355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2357/4692] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:22.396303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:22.397616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:22.399634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:22.400331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=6 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:22.406817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:22.407305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:22.407745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:22.408448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:22.408908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:22.409343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:22.543929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:22.551669 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-42cf0cfc-d47f-44b9-aec1-807e32c7c1a6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.159302 Sep 06 12:25:22.552942 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2336/4693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:22 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:23.572859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=6 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:23.578006 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:23.578746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:23.585419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:23.585927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:23.586367 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:23.587056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:23.587514 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:23.587942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:23.726268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:23.734160 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2964193d-58c5-49c0-94cf-e8940ece8a7a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1365 microversion: 2.1 time: 0.162303 Sep 06 12:25:23.734654 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2358/4694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:23 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:24.757860 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:24.758461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:24.764949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:24.765435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:24.765896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:24.766601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:24.767056 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:24.767484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:24.906238 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:25:24.914258 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d8bb6b1b-7415-4673-8923-7805ed6bfab6 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1555 microversion: 2.1 time: 0.161275 Sep 06 12:25:24.914837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2337/4695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:25:24 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:25:24.936970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:25:24.937510 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:25:24.945325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:24.945845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:24.946285 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:24.946975 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:24.947427 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:24.947854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:25.028345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6f7e931b-94fe-4a54-bdda-f1ff6227c160 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095167 Sep 06 12:25:25.028976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2359/4696] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 6 12:25:24 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:25:25.983919 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-79b4698b-a442-42ee-a76e-22caec35dd4d req-2f06fa0b-5221-4617-88b9-4b7862655f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea08004-c8a9-44dc-a50a-0bede7230496", "tag": "51ff3577-65dc-4b72-9d1b-8937a3c7a985"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:25:25.995020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-79b4698b-a442-42ee-a76e-22caec35dd4d req-2f06fa0b-5221-4617-88b9-4b7862655f06 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:25:25.995600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-79b4698b-a442-42ee-a76e-22caec35dd4d req-2f06fa0b-5221-4617-88b9-4b7862655f06 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:25:25.996113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-79b4698b-a442-42ee-a76e-22caec35dd4d req-2f06fa0b-5221-4617-88b9-4b7862655f06 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:25:26.008028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-79b4698b-a442-42ee-a76e-22caec35dd4d req-2f06fa0b-5221-4617-88b9-4b7862655f06 service nova] Creating event network-changed:51ff3577-65dc-4b72-9d1b-8937a3c7a985 for instance 6ea08004-c8a9-44dc-a50a-0bede7230496 on hv-cinder-85604 Sep 06 12:25:26.013249 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-79b4698b-a442-42ee-a76e-22caec35dd4d req-2f06fa0b-5221-4617-88b9-4b7862655f06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033128 Sep 06 12:25:26.013883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2338/4697] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:26:41.107409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:26:41.108144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:26:41.164780 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:26:41.165275 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:26:41.171307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:26:41.171787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:26:41.172219 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:26:41.172906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:26:41.173352 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:26:41.173803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:26:41.196776 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee2c4380-6746-4567-9e49-8a2ef241d5d2 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/ips" status: 200 len: 150 microversion: 2.1 time: 0.091437 Sep 06 12:26:41.197334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2360/4698] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:26:41 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:01.547186 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:29:01.548360 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:01.550215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:01.551133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:29:01.551272 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:29:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:29:01.554117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:29:01.554319 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:29:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:29:01.556060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:29:01.556205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:29:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:29:01.565861 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfb55206-68ec-4a48-8de1-4eb259bc8f5a"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:01.568599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:01.590222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:01.590811 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:01.591400 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:01.592161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:01.592631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:01.593068 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:02.558220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56790. Sep 06 12:29:02.715408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:29:02.716001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:29:02.717880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:29:02.718137 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:29:02.719949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:29:02.720337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments (ip 10.222.0.18) !!! Sep 06 12:29:02.722014 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:02.723322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:02.728028 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44e0e757-93f4-49c6-b5a6-601ba8d35633"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:02.730736 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:02.745846 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:02.746358 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:02.746802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:02.747744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:02.748389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:02.748988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:03.270964 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a1acacb-8ce5-4404-9c18-a9db8184a23b tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.725775 Sep 06 12:29:03.271930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2339/4699] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 12:29:01 2022] POST /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments => generated 194 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:03.277708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:03.278309 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:03.287510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:03.288503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:03.289106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:03.289870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:03.290411 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:03.290823 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:03.336534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:29:03.342967 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-71384616-31fe-4eb6-88a4-a4a4fd83ff3c tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "POST /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629073 Sep 06 12:29:03.343971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2361/4700] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 12:29:02 2022] POST /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:03.456223 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7a388c06-b22a-4d03-87f4-bae99806b269 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "DELETE /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 204 len: 0 microversion: 2.1 time: 0.182780 Sep 06 12:29:03.456816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2340/4701] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:03 2022] DELETE /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:29:03.468962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:03.470349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:03.477231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:03.477746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:03.478184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:03.478903 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:03.479402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:03.480019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:03.692481 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:03.701359 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5375ff78-eae0-4052-a17c-7ba80153c073 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1508 microversion: 2.1 time: 0.237978 Sep 06 12:29:03.701996 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2362/4702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:03 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:29:04.739066 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:04.739676 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:04.746355 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:04.746855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:04.747294 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:04.748005 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:04.748464 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:04.748890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:04.893436 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:04.901527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7d252359-1e62-4b0d-8388-904dcd0f5311 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1508 microversion: 2.1 time: 0.166908 Sep 06 12:29:04.902146 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2341/4703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:04 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:05.936746 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:05.937639 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:05.945496 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:05.945871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:05.946306 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:05.947009 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:05.947460 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:05.947879 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:06.221279 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:06.234175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-57951ef1-0f14-433a-8061-10a3f130b950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1508 microversion: 2.1 time: 0.309433 Sep 06 12:29:06.235704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2363/4704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:05 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:06.504032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-7e1ee1a0-9da7-43eb-9bad-6185b18cc6be req-d73ea676-62d1-4b93-afeb-b334035857f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276be2d2-5442-4aa5-9eda-a25444b0bfb0", "name": "network-vif-deleted", "tag": "cbaef624-f760-407b-97bf-32231dc062bf"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:06.515872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7e1ee1a0-9da7-43eb-9bad-6185b18cc6be req-d73ea676-62d1-4b93-afeb-b334035857f0 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:06.516786 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7e1ee1a0-9da7-43eb-9bad-6185b18cc6be req-d73ea676-62d1-4b93-afeb-b334035857f0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:06.517767 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7e1ee1a0-9da7-43eb-9bad-6185b18cc6be req-d73ea676-62d1-4b93-afeb-b334035857f0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:06.527209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-264e8762-6a1d-49c3-8112-65fbe071c27f req-60323357-9aed-4082-9aba-3e3951623a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a748-0471-4506-b2e8-7b3d85289c54", "name": "network-vif-deleted", "tag": "1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:06.532103 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-7e1ee1a0-9da7-43eb-9bad-6185b18cc6be req-d73ea676-62d1-4b93-afeb-b334035857f0 service nova] Creating event network-vif-deleted:cbaef624-f760-407b-97bf-32231dc062bf for instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 on hv-cinder-85604 Sep 06 12:29:06.537819 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-7e1ee1a0-9da7-43eb-9bad-6185b18cc6be req-d73ea676-62d1-4b93-afeb-b334035857f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119137 Sep 06 12:29:06.539088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2342/4705] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:06.539671 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-264e8762-6a1d-49c3-8112-65fbe071c27f req-60323357-9aed-4082-9aba-3e3951623a88 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:06.540419 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-264e8762-6a1d-49c3-8112-65fbe071c27f req-60323357-9aed-4082-9aba-3e3951623a88 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:06.540869 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-264e8762-6a1d-49c3-8112-65fbe071c27f req-60323357-9aed-4082-9aba-3e3951623a88 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:06.553501 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-264e8762-6a1d-49c3-8112-65fbe071c27f req-60323357-9aed-4082-9aba-3e3951623a88 service nova] Creating event network-vif-deleted:1cdb2ae3-c97e-4fe7-aaf4-44a064d2548e for instance 0878a748-0471-4506-b2e8-7b3d85289c54 on hv-cinder-85604 Sep 06 12:29:06.559052 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-264e8762-6a1d-49c3-8112-65fbe071c27f req-60323357-9aed-4082-9aba-3e3951623a88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110276 Sep 06 12:29:06.559656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2364/4706] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:07.269105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:07.270597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:07.277199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:07.278417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:07.279088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:07.280108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:07.280803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:07.281461 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:07.320328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:07.320831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:07.321278 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:07.322339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'fault' on Instance uuid 276be2d2-5442-4aa5-9eda-a25444b0bfb0 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:07.373935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:07.391235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0f051cc2-7926-42cb-a0eb-27ff54e83ecd tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1312 microversion: 2.1 time: 0.129213 Sep 06 12:29:07.395266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2343/4707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:07 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:08.420852 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:08.421557 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:08.429898 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:08.430433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:08.430828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:08.431520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:08.432081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:08.432392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:08.465506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:08.466060 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:08.466495 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:08.466935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'fault' on Instance uuid 276be2d2-5442-4aa5-9eda-a25444b0bfb0 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:08.515360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:08.524174 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-198c0999-e474-4214-a696-5bf84a3bd2b6 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1312 microversion: 2.1 time: 0.107382 Sep 06 12:29:08.524766 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2365/4708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:08 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:08.557484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-b8857a3f-e307-420d-a41e-5836485f159d req-c9e0e257-48dd-4128-bfbb-2cc50c911d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25daad-79a8-415a-bfb0-7678bbfe0ef2", "name": "network-vif-deleted", "tag": "fef9b85e-f761-4bd9-b17c-5448646f031d"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:08.570044 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b8857a3f-e307-420d-a41e-5836485f159d req-c9e0e257-48dd-4128-bfbb-2cc50c911d68 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:08.570704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b8857a3f-e307-420d-a41e-5836485f159d req-c9e0e257-48dd-4128-bfbb-2cc50c911d68 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:08.571451 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b8857a3f-e307-420d-a41e-5836485f159d req-c9e0e257-48dd-4128-bfbb-2cc50c911d68 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:08.584656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-b8857a3f-e307-420d-a41e-5836485f159d req-c9e0e257-48dd-4128-bfbb-2cc50c911d68 service nova] Creating event network-vif-deleted:fef9b85e-f761-4bd9-b17c-5448646f031d for instance 3c25daad-79a8-415a-bfb0-7678bbfe0ef2 on hv-cinder-85604 Sep 06 12:29:08.589817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-b8857a3f-e307-420d-a41e-5836485f159d req-c9e0e257-48dd-4128-bfbb-2cc50c911d68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035923 Sep 06 12:29:08.590438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2344/4709] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:09.554108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:09.554720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:09.562848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:09.563353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:09.563783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:09.564573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:09.565472 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:09.567527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:09.605027 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:09.605511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:09.605978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:09.606429 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lazy-loading 'fault' on Instance uuid 276be2d2-5442-4aa5-9eda-a25444b0bfb0 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:09.659304 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:09.667409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-baf3174e-1610-4c39-b03a-46ae6274b381 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 200 len: 1312 microversion: 2.1 time: 0.117579 Sep 06 12:29:09.667995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2366/4710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:09 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:10.605396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-344878ca-1df4-44cb-bec7-0e287488e1d1 req-731c09d8-adfa-497f-97c8-c48faf69ffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8593b18-2abc-4a13-9c4a-3515edd30fd0", "name": "network-vif-deleted", "tag": "fa63a750-30e6-44e1-b5fd-c38ece72d632"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:10.615180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-344878ca-1df4-44cb-bec7-0e287488e1d1 req-731c09d8-adfa-497f-97c8-c48faf69ffee service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.615657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-344878ca-1df4-44cb-bec7-0e287488e1d1 req-731c09d8-adfa-497f-97c8-c48faf69ffee service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.616088 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-344878ca-1df4-44cb-bec7-0e287488e1d1 req-731c09d8-adfa-497f-97c8-c48faf69ffee service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:10.627269 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-344878ca-1df4-44cb-bec7-0e287488e1d1 req-731c09d8-adfa-497f-97c8-c48faf69ffee service nova] Creating event network-vif-deleted:fa63a750-30e6-44e1-b5fd-c38ece72d632 for instance e8593b18-2abc-4a13-9c4a-3515edd30fd0 on hv-cinder-85604 Sep 06 12:29:10.634880 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-344878ca-1df4-44cb-bec7-0e287488e1d1 req-731c09d8-adfa-497f-97c8-c48faf69ffee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Sep 06 12:29:10.635499 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2345/4711] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:10.691282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:10.691866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 276be2d2-5442-4aa5-9eda-a25444b0bfb0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:10.698646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.699132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.699571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:10.700265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.700720 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.701145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:10.716194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] HTTP exception thrown: Instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 could not be found. Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Request method failure captured: Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 HTTP/1.1 Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP8WhChmO0e747b94LLsv4KV_p1rCUXE932zqUOAR-UE2UtrNZCN0tbUBjL-WFeDraD4XTNQjdd93nctg0ubt0PCEJlAskaXtNvL_FtcYEd3DWYFBXAnyeG32oQm549hSGwUJJjmoxkUxn8TyQxBjR7moTn5NqLQ26v7kR2Gh3P1mU Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:10.717908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ef6b481491244111a479eb91e3594ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}] Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 41bc35497fe94ababe0c824a429168d3 Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 could not be found. Sep 06 12:29:10.720520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '276be2d2-5442-4aa5-9eda-a25444b0bfb0'} Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 could not be found. Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:10.722232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 could not be found. Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 could not be found. Sep 06 12:29:10.725683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:10.728076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Returning 404 to user: Instance 276be2d2-5442-4aa5-9eda-a25444b0bfb0 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:10.728076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-924b3d90-0904-47d6-9f8c-ff4729c1af2a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0" status: 404 len: 111 microversion: 2.1 time: 0.032025 Sep 06 12:29:10.728076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2367/4712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:10 2022] GET /compute/v2.1/servers/276be2d2-5442-4aa5-9eda-a25444b0bfb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:10.731022 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:10.731603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:10.737949 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.738435 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.738872 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:10.739564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.740130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.741225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:10.766143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:29:10.860318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e047cd3b-73aa-41b3-ac07-e872cffd7a7a tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 204 len: 0 microversion: 2.1 time: 0.132967 Sep 06 12:29:10.861690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2346/4713] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:10 2022] DELETE /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:29:10.870289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:10.871220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:10.879821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.880173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.880703 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:10.881628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:10.887981 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:10.888922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:11.042473 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:11.050904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-4fc31aa2-fdb7-4737-9713-059731b9eed7 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.185304 Sep 06 12:29:11.051449 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2368/4714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:10 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:11.726410 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-63481103-b8c3-4ddc-9053-ccab09115258 req-2b7ea56b-25f7-4ba1-8161-37c2acbd6bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7", "name": "network-vif-deleted", "tag": "e0ed188e-7299-4f7d-ac8d-235a45b2fab6"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:11.736416 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-63481103-b8c3-4ddc-9053-ccab09115258 req-2b7ea56b-25f7-4ba1-8161-37c2acbd6bfd service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:11.737014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-63481103-b8c3-4ddc-9053-ccab09115258 req-2b7ea56b-25f7-4ba1-8161-37c2acbd6bfd service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:11.737454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-63481103-b8c3-4ddc-9053-ccab09115258 req-2b7ea56b-25f7-4ba1-8161-37c2acbd6bfd service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:11.749331 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-63481103-b8c3-4ddc-9053-ccab09115258 req-2b7ea56b-25f7-4ba1-8161-37c2acbd6bfd service nova] Creating event network-vif-deleted:e0ed188e-7299-4f7d-ac8d-235a45b2fab6 for instance 8ef3bb1a-bcd1-402e-8abd-b158cad1a0d7 on hv-cinder-85604 Sep 06 12:29:11.754159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-63481103-b8c3-4ddc-9053-ccab09115258 req-2b7ea56b-25f7-4ba1-8161-37c2acbd6bfd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 Sep 06 12:29:11.754740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2347/4715] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:12.076382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:12.077564 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:12.085405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:12.086942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:12.087402 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:12.088413 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:12.088873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:12.089307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:12.230881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:12.239287 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1f8641ee-bafa-4e30-959f-237b3513ef28 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1522 microversion: 2.1 time: 0.169283 Sep 06 12:29:12.240610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2369/4716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:12 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:13.179170 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:13.181399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:13.187701 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.188191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.188624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.189324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.189794 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.190219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.222927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-baa29696-ea8e-4437-8512-568b5e18a1f1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049075 Sep 06 12:29:13.223503 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2348/4717] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:13 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:13.235832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:13.236383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:13.243908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.244406 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.245047 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.245791 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.246581 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.247242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.272438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:13.274395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:13.285284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3681eec2-75c9-419c-a99b-114842dc3244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/dfb55206-68ec-4a48-8de1-4eb259bc8f5a" status: 200 len: 194 microversion: 2.1 time: 0.054055 Sep 06 12:29:13.285542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.286111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2370/4718] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 6 12:29:13 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/dfb55206-68ec-4a48-8de1-4eb259bc8f5a => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:13.286226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.287674 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.289001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.290895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.290895 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.422221 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc35497fe94ababe0c824a429168d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6b481491244111a479eb91e3594ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:13.443995 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9974db97-7088-4846-bbf6-3eac9dedd950 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 200 len: 1480 microversion: 2.1 time: 0.175763 Sep 06 12:29:13.445130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2349/4719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:13 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 1480 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:13.773258 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-0cf439ab-870e-4b9d-aa0e-dfe66701be53 req-0805d16e-bfb2-4a67-a621-7ed92c5fa211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d49777e-ab48-453f-8bef-9b496e07fb75", "name": "network-vif-deleted", "tag": "1754716f-7e60-43f8-8750-dac04f227184"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:13.785017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-0cf439ab-870e-4b9d-aa0e-dfe66701be53 req-0805d16e-bfb2-4a67-a621-7ed92c5fa211 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:13.786513 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-0cf439ab-870e-4b9d-aa0e-dfe66701be53 req-0805d16e-bfb2-4a67-a621-7ed92c5fa211 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:13.787757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-0cf439ab-870e-4b9d-aa0e-dfe66701be53 req-0805d16e-bfb2-4a67-a621-7ed92c5fa211 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:13.809529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-0cf439ab-870e-4b9d-aa0e-dfe66701be53 req-0805d16e-bfb2-4a67-a621-7ed92c5fa211 service nova] Creating event network-vif-deleted:1754716f-7e60-43f8-8750-dac04f227184 for instance 8d49777e-ab48-453f-8bef-9b496e07fb75 on hv-cinder-85604 Sep 06 12:29:13.819203 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-0cf439ab-870e-4b9d-aa0e-dfe66701be53 req-0805d16e-bfb2-4a67-a621-7ed92c5fa211 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048662 Sep 06 12:29:13.820595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2371/4720] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:14.470389 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:14.471039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] [instance: 8d49777e-ab48-453f-8bef-9b496e07fb75] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:14.478101 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:14.478600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:14.479049 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:14.479757 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:14.480215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:14.480639 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:14.496121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] HTTP exception thrown: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 could not be found. Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Request method failure captured: Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 HTTP/1.1 Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP8WhChmO0e747b94LLsv4KV_p1rCUXE932zqUOAR-UE2UtrNZCN0tbUBjL-WFeDraD4XTNQjdd93nctg0ubt0PCEJlAskaXtNvL_FtcYEd3DWYFBXAnyeG32oQm549hSGwUJJjmoxkUxn8TyQxBjR7moTn5NqLQ26v7kR2Gh3P1mU Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:14.497884 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ef6b481491244111a479eb91e3594ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ef6b481491244111a479eb91e3594ae4"}]}] Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: ef6b481491244111a479eb91e3594ae4 Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1871696946 Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 41bc35497fe94ababe0c824a429168d3 Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1871696946-project Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 could not be found. Sep 06 12:29:14.499403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '8d49777e-ab48-453f-8bef-9b496e07fb75'} Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 could not be found. Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:14.500174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 could not be found. Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 could not be found. Sep 06 12:29:14.501598 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:14.502962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] Returning 404 to user: Instance 8d49777e-ab48-453f-8bef-9b496e07fb75 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:14.502962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-75f9cc89-830e-4fa2-8b42-c6ef4ad2dcd4 tempest-ServerRescueNegativeTestJSON-1871696946 tempest-ServerRescueNegativeTestJSON-1871696946-project] 10.222.0.18 "GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75" status: 404 len: 111 microversion: 2.1 time: 0.032955 Sep 06 12:29:14.502962 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2350/4721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:14 2022] GET /compute/v2.1/servers/8d49777e-ab48-453f-8bef-9b496e07fb75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:14.909465 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "095808d7-363e-4bae-8283-a8e2b58c9209"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:14.912556 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:14.920092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:14.920554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:14.920989 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:14.921757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:14.922175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:14.922602 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:15.258220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7678c899-3078-4daf-9192-e35914382359 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "POST /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353050 Sep 06 12:29:15.265010 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2372/4722] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 6 12:29:14 2022] POST /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:19.336914 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-92951f27-648f-43a1-9fc6-20c5f724ec1e tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Action: 'create', calling method: .version_select at 0x7f97f4feeaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1948828331", "metadata": {"Type": "work"}}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:19.674456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-92951f27-648f-43a1-9fc6-20c5f724ec1e tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.473591 Sep 06 12:29:19.675439 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2351/4723] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 6 12:29:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 476 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 12:29:19.690144 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5ea10c07-37db-44a6-88e8-fd1ef8d7f782 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Calling method '.version_select at 0x7f97f85e5c10>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:19.750356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5ea10c07-37db-44a6-88e8-fd1ef8d7f782 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2" status: 200 len: 353 microversion: 2.1 time: 0.065439 Sep 06 12:29:19.750984 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2373/4724] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:19 2022] GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:20.778862 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-21f3d928-d008-4bf3-b004-5776842fd6a3 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Calling method '.version_select at 0x7f97f4fc3c10>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:20.802193 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:20.803909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:20.810255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:20.810743 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:20.811180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:20.811882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:20.812342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:20.812767 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:20.845019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-21f3d928-d008-4bf3-b004-5776842fd6a3 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2" status: 200 len: 354 microversion: 2.1 time: 0.072711 Sep 06 12:29:20.845591 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2352/4725] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:20 2022] GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:20.859983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e331c524-c360-42d0-997c-9ec54158eb8e tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Calling method '.version_select at 0x7f97f4e140d0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:20.898273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'services' on Instance uuid 6ea08004-c8a9-44dc-a50a-0bede7230496 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:20.906716 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e331c524-c360-42d0-997c-9ec54158eb8e tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2" status: 200 len: 354 microversion: 2.1 time: 0.050551 Sep 06 12:29:20.907296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2353/4726] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:20 2022] GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:20.925749 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a32ca296-b0f8-463d-9716-82064458d2fc tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Calling method '.version_select at 0x7f97f5058940>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:20.975463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-29220376-8ba6-4b0c-968b-53a0f80d8516 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments/44e0e757-93f4-49c6-b5a6-601ba8d35633" status: 202 len: 0 microversion: 2.1 time: 0.177650 Sep 06 12:29:20.976202 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2374/4727] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 12:29:20 2022] DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments/44e0e757-93f4-49c6-b5a6-601ba8d35633 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:29:20.984919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:20.987479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:20.996412 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a32ca296-b0f8-463d-9716-82064458d2fc tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2" status: 202 len: 0 microversion: 2.1 time: 0.074312 Sep 06 12:29:20.996985 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2354/4728] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:29:20 2022] DELETE /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:29:20.998442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:20.998938 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:20.999373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:21.000227 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:21.000685 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:21.001108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:21.006017 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-30b30839-d4a1-4aa0-afb0-b49d8ca50f1a tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Calling method '.version_select at 0x7f97f51e8310>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:21.036171 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1b097dab-fcac-4260-8ae1-abe4fb84d674 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055383 Sep 06 12:29:21.038142 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2375/4729] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:20 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:21.060715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-30b30839-d4a1-4aa0-afb0-b49d8ca50f1a tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2" status: 200 len: 353 microversion: 2.1 time: 0.059406 Sep 06 12:29:21.061689 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2355/4730] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:21 2022] GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:22.052232 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:22.054974 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:22.062881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:22.063388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:22.063899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:22.064864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:22.065409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:22.066242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:22.076364 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09da4e13-a6b8-4c35-804e-900e37fa3702 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Calling method '.version_select at 0x7f97f8762940>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:22.089755 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:22.107076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ee7a7a99-c4f9-44ff-9c5f-de6289514da1 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060228 Sep 06 12:29:22.107722 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2376/4731] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:22 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:22.109915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-09da4e13-a6b8-4c35-804e-900e37fa3702 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] HTTP exception thrown: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09da4e13-a6b8-4c35-804e-900e37fa3702 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Request method failure captured: Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 HTTP/1.1 Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz0f80px-6OFOlzPAjwX46jmVXfORL9H5tUPQFcbSsplTIzKloe84lGWc7vMX5udU1EOfMZhFqLkJ_yFdnnzHnp8sMNfk-7kJE8tkSEPfUY8ZUHzOvvgpOpyiwZmCEhfhLrYlKbKCUk-dsw8sX7ZK7JaUQ4lqKzQWLIreLJZMOYizbA Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 13f800639e444fd09c2f9a23d4db580e Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesGetTestJSON-934055894 Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:22.113243 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13f800639e444fd09c2f9a23d4db580e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13f800639e444fd09c2f9a23d4db580e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13f800639e444fd09c2f9a23d4db580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13f800639e444fd09c2f9a23d4db580e"}]}] Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesGetTestJSON-934055894 Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 13f800639e444fd09c2f9a23d4db580e Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesGetTestJSON-934055894 Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesGetTestJSON-934055894-project Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: b970d96d88a64f41b749c4c68619f20d Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesGetTestJSON-934055894-project Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '6ee1b711-dba8-44de-876e-5dd41c38a3a2'} Sep 06 12:29:22.114619 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. (HTTP 404) (Request-ID: req-a673eec8-b636-4eca-9fcc-dba1b83dc4d2) Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:22.115421 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:29:22.117494 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 12:29:22.118618 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09da4e13-a6b8-4c35-804e-900e37fa3702 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] Returning 404 to user: Volume 6ee1b711-dba8-44de-876e-5dd41c38a3a2 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09da4e13-a6b8-4c35-804e-900e37fa3702 tempest-VolumesGetTestJSON-934055894 tempest-VolumesGetTestJSON-934055894-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2" status: 404 len: 109 microversion: 2.1 time: 0.042855 Sep 06 12:29:22.119898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2356/4732] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:22 2022] GET /compute/v2.1/os-volumes/6ee1b711-dba8-44de-876e-5dd41c38a3a2 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:23.120779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:23.122988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:23.129435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:23.129945 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:23.130387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:23.131076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:23.131561 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:23.132507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:23.164572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2cb0cfcb-a22c-4ecb-af07-4a76532abe4e tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049123 Sep 06 12:29:23.165149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2377/4733] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:23 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:24.177024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:24.179915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:24.186803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:24.187330 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:24.187771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:24.188479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:24.188936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:24.189363 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:24.221199 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-415b4cc1-d01c-471c-90cb-6b5f7efec734 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048698 Sep 06 12:29:24.221806 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2357/4734] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:24 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:25.233788 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:25.235949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:25.242629 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:25.243104 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:25.243535 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:25.244221 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:25.244668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:25.245088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:25.282995 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-50edd8b5-0136-4fe0-9ed5-4b7fdbe47eb7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053073 Sep 06 12:29:25.283583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2378/4735] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:25 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:26.296347 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:26.298527 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:26.305414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:26.305930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:26.306369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:26.307057 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:26.307509 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:26.307934 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:26.338053 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-90f6758b-f3bd-4a43-ab76-f8d8960cf5ba tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Sep 06 12:29:26.338612 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2358/4736] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:26 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:27.350301 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:27.352505 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:27.359155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:27.359644 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:27.360082 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:27.360779 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:27.361233 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:27.361676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:27.393833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e4ba4412-9f57-4dac-8d31-8f63fbde6448 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Sep 06 12:29:27.394976 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2379/4737] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:27 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:28.211858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:28.214023 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:28.220564 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.221045 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.221480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.222195 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.222642 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.223059 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.255627 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:28.262019 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-878ac621-6dd3-4409-a2bd-f8e3c006d04a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055029 Sep 06 12:29:28.262604 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2359/4738] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:28 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:28.407373 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:28.409868 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:28.409998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:28.410633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:28.418340 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.418848 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.419257 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.419646 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.419768 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.420211 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.420871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.421035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.421409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.421596 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.421895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.422229 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.455210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-7fb9c1d2-33b5-4669-b8d6-98336e3d9244 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/dfb55206-68ec-4a48-8de1-4eb259bc8f5a" status: 200 len: 194 microversion: 2.1 time: 0.049946 Sep 06 12:29:28.455825 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2360/4739] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 6 12:29:28 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/dfb55206-68ec-4a48-8de1-4eb259bc8f5a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:28.456851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5ac5691-32fd-4d50-9fac-e064be4149bf tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053921 Sep 06 12:29:28.457428 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2380/4740] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:28 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:28.466520 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:28.467009 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:28.473098 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.473589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.474060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.474755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:28.475707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:28.476141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:28.563803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lazy-loading 'services' on Instance uuid b50930d4-c6df-4994-934e-cdf1807fe0c0 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:28.635857 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fcf89927-3abd-41a8-a028-42a787d20bf5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/dfb55206-68ec-4a48-8de1-4eb259bc8f5a" status: 202 len: 0 microversion: 2.1 time: 0.173006 Sep 06 12:29:28.636454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2361/4741] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 12:29:28 2022] DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/dfb55206-68ec-4a48-8de1-4eb259bc8f5a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:29:29.470085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:29.472251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:29.479630 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:29.480125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:29.480569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:29.481265 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:29.481747 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:29.482187 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:29.513841 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-18cf789f-1eeb-4db1-b16a-9cb4663c1b95 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047704 Sep 06 12:29:29.514315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2381/4742] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:29 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:30.527813 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:30.530089 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:30.536694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:30.537169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:30.537602 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:30.538395 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:30.538845 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:30.539263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:30.569214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa4aa54f-f8c3-40da-96eb-bab920523371 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Sep 06 12:29:30.569798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2362/4743] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:30 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:31.581476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:31.583597 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:31.590251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:31.590742 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:31.591180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:31.591866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:31.592318 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:31.592744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:31.622337 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9702a28-d314-47b6-b32b-5d6fd01dd6f7 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Sep 06 12:29:31.622901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2382/4744] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:31 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:32.635447 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:32.637531 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:32.639626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:32.644963 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:32.645449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:32.645981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:32.647177 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:32.647637 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:32.648070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:32.679723 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09249118-00ff-45e9-aa38-f4331406821f tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048625 Sep 06 12:29:32.680289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2363/4745] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:32 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:33.692712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:33.695528 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:33.697985 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=47 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:33.703527 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:33.704015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:33.704487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:33.705179 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:33.705638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:33.706087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:33.737180 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1a79ad7f-1e4c-4922-813d-0022737d3596 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048444 Sep 06 12:29:33.737763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2383/4746] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:33 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 12:29:33.802055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:33.802601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:33.810034 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:33.810519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:33.810956 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:33.811646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:33.812099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:33.812522 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:33.839938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:29:33.923230 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8713e5f9-2296-4bb4-995c-abbb7ad39e72 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 204 len: 0 microversion: 2.1 time: 0.125027 Sep 06 12:29:33.927292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2364/4747] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:33 2022] DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:29:33.936500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:33.937216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:33.953908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:33.953908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:33.953908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:33.953908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:33.954216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:33.954216 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:34.098953 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:34.107321 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5d016940-a391-4c1d-98ac-bbfb6477b546 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1680 microversion: 2.1 time: 0.177518 Sep 06 12:29:34.108156 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2384/4748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:33 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:29:35.095958 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:35.096552 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:35.103606 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:35.104094 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:35.104565 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:35.105261 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:35.106181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:35.106181 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:35.131753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:35.132369 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:35.136027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-44efddb9-3a36-4689-b15a-e0680c90b201 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/095808d7-363e-4bae-8283-a8e2b58c9209" status: 200 len: 194 microversion: 2.1 time: 0.044349 Sep 06 12:29:35.136640 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2365/4749] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 6 12:29:35 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/095808d7-363e-4bae-8283-a8e2b58c9209 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:35.138709 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:35.139196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:35.139631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:35.140327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:35.140782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:35.141205 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:35.146951 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:35.147595 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:35.153724 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:35.154215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:35.154657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:35.155351 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:35.155837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:35.156267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:35.239715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lazy-loading 'services' on Instance uuid b50930d4-c6df-4994-934e-cdf1807fe0c0 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:35.289363 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:35.297477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8fde86af-7db6-444e-b10b-c57869ad855a tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1680 microversion: 2.1 time: 0.169883 Sep 06 12:29:35.298186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2385/4750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:35 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:35.317778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-16e5e16a-d4f3-449d-ab2c-95d9aa030f6a tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/095808d7-363e-4bae-8283-a8e2b58c9209" status: 202 len: 0 microversion: 2.1 time: 0.174423 Sep 06 12:29:35.318403 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2366/4751] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 6 12:29:35 2022] DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments/095808d7-363e-4bae-8283-a8e2b58c9209 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 12:29:36.322730 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:36.323961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:36.331108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:36.332033 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:36.332801 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:36.333887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:36.334440 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:36.334926 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:36.582741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:36.595595 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6d2676d6-d383-446c-b8d2-58f9f519a3d8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1680 microversion: 2.1 time: 0.276959 Sep 06 12:29:36.596937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2386/4752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:36 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:37.202082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-5f94aada-716a-45a2-af27-51b8f8e69227 req-ca70962c-a9b7-48a9-b71a-0b5dee5e08dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea08004-c8a9-44dc-a50a-0bede7230496", "name": "network-vif-deleted", "tag": "51ff3577-65dc-4b72-9d1b-8937a3c7a985"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:37.218419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-5f94aada-716a-45a2-af27-51b8f8e69227 req-ca70962c-a9b7-48a9-b71a-0b5dee5e08dd service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.222214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-5f94aada-716a-45a2-af27-51b8f8e69227 req-ca70962c-a9b7-48a9-b71a-0b5dee5e08dd service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.223256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-5f94aada-716a-45a2-af27-51b8f8e69227 req-ca70962c-a9b7-48a9-b71a-0b5dee5e08dd service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.238168 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-5f94aada-716a-45a2-af27-51b8f8e69227 req-ca70962c-a9b7-48a9-b71a-0b5dee5e08dd service nova] Creating event network-vif-deleted:51ff3577-65dc-4b72-9d1b-8937a3c7a985 for instance 6ea08004-c8a9-44dc-a50a-0bede7230496 on hv-cinder-85604 Sep 06 12:29:37.245133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-5f94aada-716a-45a2-af27-51b8f8e69227 req-ca70962c-a9b7-48a9-b71a-0b5dee5e08dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050950 Sep 06 12:29:37.254105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2367/4753] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:37.615086 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:37.619656 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:37.621259 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:37.622006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:37.628585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.629084 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.629885 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.630929 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.631487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.631737 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.632169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.632643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.632965 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.633826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.634386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.634916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.671334 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9e81a28b-ae21-41da-b1f2-beecec0f30e5 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062078 Sep 06 12:29:37.672099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.678015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.678015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.678015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lazy-loading 'fault' on Instance uuid 6ea08004-c8a9-44dc-a50a-0bede7230496 {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:29:37.689864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2387/4754] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:37 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 12:29:37.743420 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05967546ef245d2b88874f6cf3f84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4aab6e4d8f4582a2538ccd0004046c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:37.755173 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2291dadf-ac70-45bc-9b34-7705c4f2dca8 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 200 len: 1331 microversion: 2.1 time: 0.136714 Sep 06 12:29:37.756062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2368/4755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:37 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:37.847863 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:37.851585 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:37.857752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.858185 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.858798 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.859714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:37.868541 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:37.869609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:37.912201 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f56b3158-9cd2-419d-aad5-a15f65274eab tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067765 Sep 06 12:29:37.914894 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2388/4756] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 6 12:29:37 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 12:29:37.995404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:37.995920 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:38.003194 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:38.003816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:38.004354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:38.005183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:38.005778 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:38.006571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:38.042342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Going to try to terminate instance {{(pid=127121) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:29:38.128033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9d91f3b8-715a-4462-aa54-f8300fe4c1ea tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 204 len: 0 microversion: 2.1 time: 0.137199 Sep 06 12:29:38.128626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2369/4757] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:37 2022] DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:29:38.137349 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:38.138016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:38.143887 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:38.144376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:38.144800 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:38.146230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:38.148640 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:38.149226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:38.346908 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:38.357940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a41a49f0-b0cc-4ee6-818f-1f6788c83965 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1673 microversion: 2.1 time: 0.224458 Sep 06 12:29:38.369331 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2389/4758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:38 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:38.778035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:38.778747 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:38.785085 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:38.785573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:38.786174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:38.786871 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:38.787333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:38.787758 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:38.801438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 HTTP/1.1 Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:38.803409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:38.804837 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '6ea08004-c8a9-44dc-a50a-0bede7230496'} Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:38.805925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:38.807125 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:38.808318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:38.808318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-eee4a78f-b724-47e9-8fb9-f6af75df6917 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 404 len: 111 microversion: 2.1 time: 0.031524 Sep 06 12:29:38.808318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2370/4759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:38 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:38.813751 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-5493339f-6f8b-461c-b424-4432b411fe76 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '.version_select at 0x7f97f8583f70>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:38.847119 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-5493339f-6f8b-461c-b424-4432b411fe76 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124404368" status: 202 len: 0 microversion: 2.1 time: 0.037011 Sep 06 12:29:38.851628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2390/4760] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 6 12:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124404368 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:29:39.384855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:39.386354 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:39.393613 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:39.394376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:39.395175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:39.395817 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:39.396321 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:39.396748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:39.554476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:39.564172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1dfcdc7d-054f-4b83-9c54-92d4a74310b1 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1673 microversion: 2.1 time: 0.184511 Sep 06 12:29:39.565055 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2371/4761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:39 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:40.591063 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:40.591684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:40.598909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.599447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.600316 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.601053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.601518 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.602194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.676157 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbb0b2070694235bf87a7b9a0c84dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be7be1a9bb1487aac2c32871398119e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:40.686310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-925ddb92-b9fe-4859-aea4-1d58a07da23d tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 200 len: 1606 microversion: 2.1 time: 0.099251 Sep 06 12:29:40.686891 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2391/4762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:40 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 1606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:40.705585 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:40.706175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:40.717130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.718020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.718653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.719575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.720231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.720796 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.738800 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 HTTP/1.1 Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:40.741081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.742556 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '6ea08004-c8a9-44dc-a50a-0bede7230496'} Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:40.743376 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.744883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.747733 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:40.748950 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9e4163d9-af48-4e02-a87f-6f9ae573d699 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 404 len: 111 microversion: 2.1 time: 0.048520 Sep 06 12:29:40.750014 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2372/4763] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:40 2022] DELETE /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:40.759230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:40.760007 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 6ea08004-c8a9-44dc-a50a-0bede7230496] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:40.767169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.767939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.768683 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.769978 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.771036 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.771183 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-7cec0960-8f05-4c4e-86e2-a21b94ca699a req-173aa803-97dc-4437-9a7f-f256d10b6eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50930d4-c6df-4994-934e-cdf1807fe0c0", "name": "network-vif-deleted", "tag": "b9e31fca-87e5-4293-9aec-60df67f7dd46"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:40.771494 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.783133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7cec0960-8f05-4c4e-86e2-a21b94ca699a req-173aa803-97dc-4437-9a7f-f256d10b6eca service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:40.783708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7cec0960-8f05-4c4e-86e2-a21b94ca699a req-173aa803-97dc-4437-9a7f-f256d10b6eca service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:40.784325 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-7cec0960-8f05-4c4e-86e2-a21b94ca699a req-173aa803-97dc-4437-9a7f-f256d10b6eca service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:40.800906 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.803298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-7cec0960-8f05-4c4e-86e2-a21b94ca699a req-173aa803-97dc-4437-9a7f-f256d10b6eca service nova] Creating event network-vif-deleted:b9e31fca-87e5-4293-9aec-60df67f7dd46 for instance b50930d4-c6df-4994-934e-cdf1807fe0c0 on hv-cinder-85604 Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 HTTP/1.1 Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:40.804035 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.805604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '6ea08004-c8a9-44dc-a50a-0bede7230496'} Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:40.806476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. Sep 06 12:29:40.807907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:40.811895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance 6ea08004-c8a9-44dc-a50a-0bede7230496 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:40.812966 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-1f6e15d1-a741-4932-99dd-5d91fa439b12 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496" status: 404 len: 111 microversion: 2.1 time: 0.058880 Sep 06 12:29:40.817004 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-7cec0960-8f05-4c4e-86e2-a21b94ca699a req-173aa803-97dc-4437-9a7f-f256d10b6eca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051580 Sep 06 12:29:40.817520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2392/4764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:40 2022] GET /compute/v2.1/servers/6ea08004-c8a9-44dc-a50a-0bede7230496 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:40.817632 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2373/4765] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:41.715325 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:41.717455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:41.730969 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:41.731979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:41.733039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:41.734249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:41.735023 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:41.735912 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:41.754310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] HTTP exception thrown: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Request method failure captured: Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 HTTP/1.1 Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP5zxoJCsQ94Sv_3J3s2FCX6zNA1yzcizoKlq5Ycqlsko0Drt9xW-tOfNRZQeO2uhbEfPV-bMARcxjq4qEv3msXm_nInHC3pFOQNGpCIr_zfU_MxdbLdFvafRwwqLQF4E0VL9mw6r4Jz6GEp14593bhqthkDabXjp0w5A109H_Ooiw Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:41.758310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}] Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: ccbb0b2070694235bf87a7b9a0c84dbe Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:41.759628 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'b50930d4-c6df-4994-934e-cdf1807fe0c0'} Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:41.760347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:41.761455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:41.768802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Returning 404 to user: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:41.768802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c51c0fc3-9fa2-4440-96d6-a758e5933a45 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 404 len: 111 microversion: 2.1 time: 0.051775 Sep 06 12:29:41.768802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2393/4766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:41 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:41.772033 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-77a6301d-726b-400d-8df4-facb121d2395 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '.version_select at 0x7f97f5058940>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:41.804307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-77a6301d-726b-400d-8df4-facb121d2395 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274975530" status: 202 len: 0 microversion: 2.1 time: 0.036908 Sep 06 12:29:41.805289 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2374/4767] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 6 12:29:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274975530 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:29:42.049919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:42.050750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:42.057712 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.058433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.059083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.060194 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.061067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.061738 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.103816 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 HTTP/1.1 Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:42.110509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.111955 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'e71ac230-7b8b-496d-951a-748db65f4839'} Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:42.112666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.113899 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.115173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:42.115173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ca2b533b-efe7-45e2-8763-62205b416653 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 404 len: 111 microversion: 2.1 time: 0.066759 Sep 06 12:29:42.115173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2394/4768] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:42 2022] DELETE /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:42.121626 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:42.122696 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: e71ac230-7b8b-496d-951a-748db65f4839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:42.142530 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.143077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.143561 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.144367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.144873 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.145307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.173224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:42.174783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 HTTP/1.1 Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:42.176645 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.178474 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': 'e71ac230-7b8b-496d-951a-748db65f4839'} Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:42.179247 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. Sep 06 12:29:42.180391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.181398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance e71ac230-7b8b-496d-951a-748db65f4839 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:42.181398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-83e55b58-d904-484a-bdc7-cc21984d7606 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839" status: 404 len: 111 microversion: 2.1 time: 0.061439 Sep 06 12:29:42.181398 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2375/4769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:42 2022] GET /compute/v2.1/servers/e71ac230-7b8b-496d-951a-748db65f4839 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:42.187927 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:42.188276 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:42.195750 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.196248 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.196700 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.197399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.197889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.198317 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.216466 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 HTTP/1.1 Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:42.218213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.219475 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'cde6a07d-6352-44f1-9e8d-84babe614815'} Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:42.220175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.222153 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.225090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:42.225090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7644c9d0-b48c-461f-8219-11d20bfeebd3 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 404 len: 111 microversion: 2.1 time: 0.035869 Sep 06 12:29:42.225090 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2395/4770] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:42 2022] DELETE /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:42.233524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:42.234112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: cde6a07d-6352-44f1-9e8d-84babe614815] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:42.246388 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.246874 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.247303 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.247998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:42.248442 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:42.248866 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:42.264643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 HTTP/1.1 Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:42.266156 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.267419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': 'cde6a07d-6352-44f1-9e8d-84babe614815'} Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:42.268106 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. Sep 06 12:29:42.269214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:42.270441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance cde6a07d-6352-44f1-9e8d-84babe614815 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:42.270441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ed2f5c87-3b0e-4cdb-8d94-c863c50dcfcc tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815" status: 404 len: 111 microversion: 2.1 time: 0.042311 Sep 06 12:29:42.270441 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2376/4771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:42 2022] GET /compute/v2.1/servers/cde6a07d-6352-44f1-9e8d-84babe614815 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:43.441770 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:43.442281 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:43.448609 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:43.449093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:43.449529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:43.450477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:43.450672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:43.451121 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:43.464714 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 HTTP/1.1 Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:43.466299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.467726 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '23cb205f-f79a-4c52-b0e3-190868135839'} Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:43.468619 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.469826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.472041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:43.472041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-08c1242c-1b24-450a-85fc-a82bf4ca65ed tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 404 len: 111 microversion: 2.1 time: 0.029743 Sep 06 12:29:43.472041 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2396/4772] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:43 2022] DELETE /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:43.478653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:43.479356 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] [instance: 23cb205f-f79a-4c52-b0e3-190868135839] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:43.485917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:43.486396 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:43.486829 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:43.487519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:43.487974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:43.488393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:43.503583 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] HTTP exception thrown: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Request method failure captured: Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 HTTP/1.1 Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP6L6Z2q2lpwS6ZtuKME5iz0oA30uxkhhQcaKyMpq1pOC_AhvKX5o78JHXquJBsWNQ5oHNQyzHiaYGulkbd-hvk_2xL7_fb5X6RBmU_MhsgZ7CTULcRNQOo0rakfbkbOr39KJQbl42hhcpz5BTW-WLUb5MK-sIfBmoVCaArkvaUGsM Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:43.505159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb4aab6e4d8f4582a2538ccd0004046c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb4aab6e4d8f4582a2538ccd0004046c"}]}] Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: eb4aab6e4d8f4582a2538ccd0004046c Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237046612 Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e05967546ef245d2b88874f6cf3f84fd Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeNegativeTest-1237046612-project Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.507133 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '23cb205f-f79a-4c52-b0e3-190868135839'} Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:43.507849 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. Sep 06 12:29:43.509013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:43.510067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] Returning 404 to user: Instance 23cb205f-f79a-4c52-b0e3-190868135839 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:43.510067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-24f16e8d-4767-406b-a38e-5286c8620fd5 tempest-AttachVolumeNegativeTest-1237046612 tempest-AttachVolumeNegativeTest-1237046612-project] 10.222.0.18 "GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839" status: 404 len: 111 microversion: 2.1 time: 0.033511 Sep 06 12:29:43.510067 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2377/4773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:43 2022] GET /compute/v2.1/servers/23cb205f-f79a-4c52-b0e3-190868135839 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:44.891517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:44.892615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:44.901401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:44.902099 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:44.903040 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:44.904111 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:44.904744 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:44.905436 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:44.927175 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] HTTP exception thrown: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Request method failure captured: Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 HTTP/1.1 Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP5zxoJCsQ94Sv_3J3s2FCX6zNA1yzcizoKlq5Ycqlsko0Drt9xW-tOfNRZQeO2uhbEfPV-bMARcxjq4qEv3msXm_nInHC3pFOQNGpCIr_zfU_MxdbLdFvafRwwqLQF4E0VL9mw6r4Jz6GEp14593bhqthkDabXjp0w5A109H_Ooiw Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:44.929145 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}] Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: ccbb0b2070694235bf87a7b9a0c84dbe Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.930756 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'b50930d4-c6df-4994-934e-cdf1807fe0c0'} Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:44.931638 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.933241 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.934605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Returning 404 to user: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:44.934605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f85f49e4-4721-4950-9044-82fb42813309 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 404 len: 111 microversion: 2.1 time: 0.044559 Sep 06 12:29:44.934605 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2397/4774] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:44 2022] DELETE /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:44.942616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:44.943841 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: b50930d4-c6df-4994-934e-cdf1807fe0c0] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:44.950977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:44.951910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:44.952252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:44.953028 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:44.953549 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:44.954083 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:44.977594 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] HTTP exception thrown: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Request method failure captured: Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 HTTP/1.1 Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP5zxoJCsQ94Sv_3J3s2FCX6zNA1yzcizoKlq5Ycqlsko0Drt9xW-tOfNRZQeO2uhbEfPV-bMARcxjq4qEv3msXm_nInHC3pFOQNGpCIr_zfU_MxdbLdFvafRwwqLQF4E0VL9mw6r4Jz6GEp14593bhqthkDabXjp0w5A109H_Ooiw Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:44.980263 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}] Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: ccbb0b2070694235bf87a7b9a0c84dbe Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.982141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': 'b50930d4-c6df-4994-934e-cdf1807fe0c0'} Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:44.982930 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. Sep 06 12:29:44.984134 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:44.985456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Returning 404 to user: Instance b50930d4-c6df-4994-934e-cdf1807fe0c0 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:44.985456 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9f4fdfd-90a8-4fe8-a7e2-5769800f67db tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0" status: 404 len: 111 microversion: 2.1 time: 0.044613 Sep 06 12:29:44.986000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2378/4775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:44 2022] GET /compute/v2.1/servers/b50930d4-c6df-4994-934e-cdf1807fe0c0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:46.173408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:46.175189 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:46.183577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:46.184166 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:46.184704 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:46.185925 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:46.186741 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:46.187249 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:46.192114 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=100 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:29:46.205019 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] HTTP exception thrown: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Request method failure captured: Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 HTTP/1.1 Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzP5zxoJCsQ94Sv_3J3s2FCX6zNA1yzcizoKlq5Ycqlsko0Drt9xW-tOfNRZQeO2uhbEfPV-bMARcxjq4qEv3msXm_nInHC3pFOQNGpCIr_zfU_MxdbLdFvafRwwqLQF4E0VL9mw6r4Jz6GEp14593bhqthkDabXjp0w5A109H_Ooiw Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:29:46.207005 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}] Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: ccbb0b2070694235bf87a7b9a0c84dbe Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.208347 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '2942181c-63de-4194-946d-9d8ca5c4b4a3'} Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:46.209669 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.210988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.212457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Returning 404 to user: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:46.212457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9a5704bb-a508-4226-9912-7ecf20247a68 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 404 len: 111 microversion: 2.1 time: 0.039346 Sep 06 12:29:46.212457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2398/4776] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:29:46 2022] DELETE /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 12:29:46.219315 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:46.219928 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] [instance: 2942181c-63de-4194-946d-9d8ca5c4b4a3] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:46.227143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:46.227579 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:46.228008 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:46.228704 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:46.229150 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:46.229567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:46.246027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] HTTP exception thrown: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Request method failure captured: Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 HTTP/1.1 Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzP5zxoJCsQ94Sv_3J3s2FCX6zNA1yzcizoKlq5Ycqlsko0Drt9xW-tOfNRZQeO2uhbEfPV-bMARcxjq4qEv3msXm_nInHC3pFOQNGpCIr_zfU_MxdbLdFvafRwwqLQF4E0VL9mw6r4Jz6GEp14593bhqthkDabXjp0w5A109H_Ooiw Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:29:46.247859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2be7be1a9bb1487aac2c32871398119e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2be7be1a9bb1487aac2c32871398119e"}]}] Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 2be7be1a9bb1487aac2c32871398119e Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1668367985 Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: ccbb0b2070694235bf87a7b9a0c84dbe Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeTestJSON-1668367985-project Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.249341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '2942181c-63de-4194-946d-9d8ca5c4b4a3'} Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:29:46.250217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. Sep 06 12:29:46.251570 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:29:46.252783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] Returning 404 to user: Instance 2942181c-63de-4194-946d-9d8ca5c4b4a3 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:29:46.252783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-09f30eac-bc4e-4d14-a591-b4e021993e52 tempest-AttachVolumeTestJSON-1668367985 tempest-AttachVolumeTestJSON-1668367985-project] 10.222.0.18 "GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3" status: 404 len: 111 microversion: 2.1 time: 0.036424 Sep 06 12:29:46.252783 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2379/4777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:46 2022] GET /compute/v2.1/servers/2942181c-63de-4194-946d-9d8ca5c4b4a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:29:49.366570 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1866734802", "imageRef": "c2906a13-ea0e-4973-98db-cf62555f2a8a", "flavorRef": "452"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:49.434752 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.network.neutron [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] validate_networks() for None {{(pid=127122) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:29:49.884362 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Flavor limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:29:49.885044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Image limits 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:29:49.885718 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Flavor pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:29:49.886138 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Image pref 0:0:0 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:29:49.886554 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.virt.hardware [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:29:49.895717 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:49.896872 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:49.897961 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:49.898130 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:49.898524 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:49.898960 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:49.924498 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Getting quotas for project 26fe7ddc88334bc6a7912c5fa07b9516. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:29:49.929083 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Getting quotas for user 71dcf98c074847158fabdb71a7594902 and project 26fe7ddc88334bc6a7912c5fa07b9516. Resources: {'instances', 'ram', 'cores'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:29:49.941408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Going to run 1 instances... {{(pid=127122) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:29:49.944329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c2906a13-ea0e-4973-98db-cf62555f2a8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:29:50.006389 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-30208e5a-9272-4c37-83b5-2df41c4f08d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641637 Sep 06 12:29:50.007935 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2399/4778] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 12:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 12:29:50.018485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-42aca64b-5195-4bc1-a62f-31845a31dabd tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:50.019742 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-42aca64b-5195-4bc1-a62f-31845a31dabd tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:50.132938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-42aca64b-5195-4bc1-a62f-31845a31dabd tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:50.142077 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-42aca64b-5195-4bc1-a62f-31845a31dabd tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1215 microversion: 2.1 time: 0.127196 Sep 06 12:29:50.142692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2380/4779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:50 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:51.168103 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:51.169354 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:51.177797 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:51.178866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:51.179678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:51.180604 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:51.181356 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:51.181873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:51.264339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:51.276861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c387c707-39bf-4380-8c11-f31688a293d3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1267 microversion: 2.1 time: 0.112348 Sep 06 12:29:51.277729 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2400/4780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:51 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:52.303448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:52.304222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:52.317141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:52.317638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:52.318138 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:52.318846 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:52.319485 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:52.319917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:52.397836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:52.408196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d48937ce-fb38-4bea-af39-a04f027d1122 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1273 microversion: 2.1 time: 0.110713 Sep 06 12:29:52.409519 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2381/4781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:52 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:53.433393 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:53.434026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:53.441182 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:53.441895 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:53.442345 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:53.443907 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:53.444649 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:53.445087 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:53.661042 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:53.673796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b9ca427c-442e-48ce-b81a-694af2fc1ef7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.244463 Sep 06 12:29:53.677107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2401/4782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:53 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:53.953977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-b432caad-f62d-48c3-a798-2d896b751b3b req-7457f47a-ff6d-43a3-a26e-4574b0cdd223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a9f4f-aff8-4fc3-a971-cc7bd166f508", "tag": "e917ba9e-4aeb-4d51-9c23-6e8904d4d904"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:29:53.976161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b432caad-f62d-48c3-a798-2d896b751b3b req-7457f47a-ff6d-43a3-a26e-4574b0cdd223 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:53.976647 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b432caad-f62d-48c3-a798-2d896b751b3b req-7457f47a-ff6d-43a3-a26e-4574b0cdd223 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:53.977078 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-b432caad-f62d-48c3-a798-2d896b751b3b req-7457f47a-ff6d-43a3-a26e-4574b0cdd223 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:53.989305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-b432caad-f62d-48c3-a798-2d896b751b3b req-7457f47a-ff6d-43a3-a26e-4574b0cdd223 service nova] Creating event network-changed:e917ba9e-4aeb-4d51-9c23-6e8904d4d904 for instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 on hv-cinder-85604 Sep 06 12:29:53.996185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-b432caad-f62d-48c3-a798-2d896b751b3b req-7457f47a-ff6d-43a3-a26e-4574b0cdd223 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052833 Sep 06 12:29:53.997241 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2382/4783] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:54.240737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9aa754c4-3101-4e7e-a1c9-3c18923f0cda tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f862bdc0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:54.311417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9aa754c4-3101-4e7e-a1c9-3c18923f0cda tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8248718a-fd30-4fa6-882c-dd0d9a8eb8c6" status: 200 len: 351 microversion: 2.1 time: 0.076164 Sep 06 12:29:54.311986 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2402/4784] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:54 2022] GET /compute/v2.1/os-volumes/8248718a-fd30-4fa6-882c-dd0d9a8eb8c6 => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:54.707143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:54.707765 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:54.714573 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:54.715062 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:54.715498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:54.716189 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:54.716646 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:54.717074 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:54.848834 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:54.856610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-bdf3c0f3-23c0-496f-a853-1dbb57cd9f27 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.153772 Sep 06 12:29:54.857178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2383/4785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:54 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:55.661330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-dc8112be-300e-41a1-96bd-c1c11cd372d5 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f8731550>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:55.710259 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-dc8112be-300e-41a1-96bd-c1c11cd372d5 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f8fd1678-f0b5-419a-9089-fc51ec21a4e4" status: 200 len: 350 microversion: 2.1 time: 0.053043 Sep 06 12:29:55.710904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2403/4786] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:55 2022] GET /compute/v2.1/os-volumes/f8fd1678-f0b5-419a-9089-fc51ec21a4e4 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:55.881120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:55.881631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:55.888715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:55.889220 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:55.889678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:55.890548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:55.891015 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:55.891437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:56.042081 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:56.050162 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2b7d1c69-b96e-44e1-bbfc-3b9395562e00 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.173452 Sep 06 12:29:56.050848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2384/4787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:55 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:57.075601 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.076284 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:57.083284 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d129a691-fa5a-4548-b5d3-5c871d5af445 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f506c280>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.084464 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:57.084983 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:57.085666 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:57.086447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:57.087116 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:57.087632 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:57.136506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d129a691-fa5a-4548-b5d3-5c871d5af445 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/92736648-d41a-4a42-8632-76d61a20e616" status: 200 len: 350 microversion: 2.1 time: 0.056922 Sep 06 12:29:57.137225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2385/4788] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes/92736648-d41a-4a42-8632-76d61a20e616 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:57.151404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-801702d2-d8c3-45c1-a7d5-668a639ff613 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f503fd30>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.237500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-801702d2-d8c3-45c1-a7d5-668a639ff613 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089922 Sep 06 12:29:57.238234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2386/4789] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:29:57.253620 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1bfcc3b-2348-4220-b95a-545c2c410d72 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f86de430>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.315667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:57.324442 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0d7f596f-8f74-4bc8-bc14-f2afeb39ae3b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.253180 Sep 06 12:29:57.325289 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2404/4790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:57.340153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c1bfcc3b-2348-4220-b95a-545c2c410d72 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090134 Sep 06 12:29:57.340803 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2387/4791] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:29:57.355520 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d300066b-61b3-4ccd-bd6f-afe9fcbce33b tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f87311f0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.437578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d300066b-61b3-4ccd-bd6f-afe9fcbce33b tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085774 Sep 06 12:29:57.438199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2405/4792] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:57.452095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c53f6687-d553-4f4c-962d-c263fb816848 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f503f430>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.534003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c53f6687-d553-4f4c-962d-c263fb816848 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085561 Sep 06 12:29:57.534580 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2388/4793] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:57.548944 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a3a7256b-d223-49d9-a0d6-3ea7a59f7b3e tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f4988c10>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.636652 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a3a7256b-d223-49d9-a0d6-3ea7a59f7b3e tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091447 Sep 06 12:29:57.637231 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2406/4794] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:57.651678 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-552b2e23-3fcb-4afa-ac66-51321e2a7ae9 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f4feeaf0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.737870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-552b2e23-3fcb-4afa-ac66-51321e2a7ae9 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089863 Sep 06 12:29:57.738443 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2389/4795] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:57.751921 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-0f51e540-e987-42cc-880b-b9e186d0e07d tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f514c040>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.836988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-0f51e540-e987-42cc-880b-b9e186d0e07d tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088743 Sep 06 12:29:57.837551 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2407/4796] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:29:57.851305 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ab799517-d149-4e70-9820-1ef2ea358c17 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] Calling method '.version_select at 0x7f97f4f59ee0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:57.939322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ab799517-d149-4e70-9820-1ef2ea358c17 tempest-VolumesTestJSON-1185381089 tempest-VolumesTestJSON-1185381089-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092150 Sep 06 12:29:57.939911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2390/4797] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Sep 6 12:29:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:58.348376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:58.349521 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:58.356407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:58.356949 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:58.357617 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:58.358446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:58.359061 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:58.359625 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:58.496122 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:58.504476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-634efbef-8a95-430b-b6b5-49b89041d441 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.160581 Sep 06 12:29:58.505048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2408/4798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:58 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:29:59.528677 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:29:59.529433 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:29:59.535362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:59.535839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:59.536275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:59.537007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:29:59.537457 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:29:59.537902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:29:59.683205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:29:59.690876 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6bc7b382-cb3a-4e71-9c95-72e65c0d51ec tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.167294 Sep 06 12:29:59.691684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2391/4799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:29:59 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:00.655706 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:30:00.656831 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=6 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:30:00.727624 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:00.730417 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:00.733789 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:30:00.739350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:00.740404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:00.740844 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:00.741555 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:00.742113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:00.745946 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:00.805781 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-15407e93-9ee3-4fb6-9e7d-c54a1d9a74dc req-4b1e3c94-36b5-4b7d-ad9a-17da2ed406fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a9f4f-aff8-4fc3-a971-cc7bd166f508", "name": "network-vif-plugged", "status": "completed", "tag": "e917ba9e-4aeb-4d51-9c23-6e8904d4d904"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:30:00.818455 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-15407e93-9ee3-4fb6-9e7d-c54a1d9a74dc req-4b1e3c94-36b5-4b7d-ad9a-17da2ed406fa service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:00.819299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-15407e93-9ee3-4fb6-9e7d-c54a1d9a74dc req-4b1e3c94-36b5-4b7d-ad9a-17da2ed406fa service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:00.820000 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-15407e93-9ee3-4fb6-9e7d-c54a1d9a74dc req-4b1e3c94-36b5-4b7d-ad9a-17da2ed406fa service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:00.832901 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-15407e93-9ee3-4fb6-9e7d-c54a1d9a74dc req-4b1e3c94-36b5-4b7d-ad9a-17da2ed406fa service nova] Creating event network-vif-plugged:e917ba9e-4aeb-4d51-9c23-6e8904d4d904 for instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 on hv-cinder-85604 Sep 06 12:30:00.840274 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-15407e93-9ee3-4fb6-9e7d-c54a1d9a74dc req-4b1e3c94-36b5-4b7d-ad9a-17da2ed406fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189858 Sep 06 12:30:00.841125 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2409/4800] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:30:00.920893 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:30:00.931982 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-125ce1ee-e1b4-4848-8dd5-f5971966ef5b tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.209042 Sep 06 12:30:00.932936 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2392/4801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:00 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:01.955950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:01.956805 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:01.963370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:01.963940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:01.964446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:01.965209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:01.965772 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:01.966329 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:02.129796 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:30:02.139150 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-506fb72c-960c-46c3-a11b-c85750a77500 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1315 microversion: 2.1 time: 0.187928 Sep 06 12:30:02.139734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2410/4802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:01 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:02.850918 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-801f898c-45cf-442f-9e91-567bc251dc75 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Action: 'create', calling method: .version_select at 0x7f97f86814c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1711861407", "metadata": {"Type": "work"}}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-801f898c-45cf-442f-9e91-567bc251dc75 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Request method failure captured: Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 122 Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz1KOFofVEUw3dqm-kQ7EN2Y0rjTBHnJ32Qk9XDnkqmjRBJtGGXssMxb0P8qAnt8uN-HSfrgZmW3EE4QknwfNqHA4Oud2mY2VlXbph-YEucMNL_sF2UXEbxlyImr5NQRRw82WlsroljQ05XaVHgC31mLzolDUBVG98FEMl5cJfp9LcQ Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:30:02.872035 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/390efc66a4a54d33ad682e3022524588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_390efc66a4a54d33ad682e3022524588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}] Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: f7925d08c85a404bbe6cba11ac339da4 Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1711861407", "metadata": {"Type": "work"}}} Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: Sep 06 12:30:02.873663 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1711861407', 'metadata': {'Type': 'work'}}}} Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise error Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:02.874703 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 12:30:02.876070 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 12:30:02.877265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 12:30:02.877265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.877265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-801f898c-45cf-442f-9e91-567bc251dc75 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:02.877265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-801f898c-45cf-442f-9e91-567bc251dc75 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143592 Sep 06 12:30:02.877265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2393/4803] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 6 12:30:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:30:02.885252 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c519af56-205a-4022-922c-63ba4e9bf8fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Action: 'create', calling method: .version_select at 0x7f97f8583940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-821372039", "metadata": {"Type": "work"}}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c519af56-205a-4022-922c-63ba4e9bf8fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Request method failure captured: Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 119 Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFz1KOFofVEUw3dqm-kQ7EN2Y0rjTBHnJ32Qk9XDnkqmjRBJtGGXssMxb0P8qAnt8uN-HSfrgZmW3EE4QknwfNqHA4Oud2mY2VlXbph-YEucMNL_sF2UXEbxlyImr5NQRRw82WlsroljQ05XaVHgC31mLzolDUBVG98FEMl5cJfp9LcQ Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:30:02.890209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/390efc66a4a54d33ad682e3022524588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_390efc66a4a54d33ad682e3022524588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}] Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: f7925d08c85a404bbe6cba11ac339da4 Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-821372039", "metadata": {"Type": "work"}}} Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: Sep 06 12:30:02.891749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-821372039', 'metadata': {'Type': 'work'}}}} Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise error Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi '0' Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:02.892582 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 12:30:02.894154 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 12:30:02.895365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 12:30:02.895365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.895365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-c519af56-205a-4022-922c-63ba4e9bf8fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:02.895365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-c519af56-205a-4022-922c-63ba4e9bf8fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010440 Sep 06 12:30:02.895365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2411/4804] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 6 12:30:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:30:02.902610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f498d9a0-d964-410d-86ae-5f718ddb4382 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Action: 'create', calling method: .version_select at 0x7f97f5cc1af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1641102786", "metadata": {"Type": "work"}}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f498d9a0-d964-410d-86ae-5f718ddb4382 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Request method failure captured: Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 119 Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz1KOFofVEUw3dqm-kQ7EN2Y0rjTBHnJ32Qk9XDnkqmjRBJtGGXssMxb0P8qAnt8uN-HSfrgZmW3EE4QknwfNqHA4Oud2mY2VlXbph-YEucMNL_sF2UXEbxlyImr5NQRRw82WlsroljQ05XaVHgC31mLzolDUBVG98FEMl5cJfp9LcQ Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:30:02.906159 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/390efc66a4a54d33ad682e3022524588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_390efc66a4a54d33ad682e3022524588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}] Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: f7925d08c85a404bbe6cba11ac339da4 Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1641102786", "metadata": {"Type": "work"}}} Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: Sep 06 12:30:02.907656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1641102786', 'metadata': {'Type': 'work'}}}} Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise error Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi '' Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:02.908500 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 12:30:02.910120 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 12:30:02.911291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 12:30:02.911291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.911291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f498d9a0-d964-410d-86ae-5f718ddb4382 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:02.911291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f498d9a0-d964-410d-86ae-5f718ddb4382 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008981 Sep 06 12:30:02.911291 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2394/4805] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 6 12:30:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:30:02.916657 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efa40e75-9b9a-4b32-af59-df93a406de09 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Calling method '.version_select at 0x7f97f499c820>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:02.946093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-efa40e75-9b9a-4b32-af59-df93a406de09 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] HTTP exception thrown: Volume tempest-invalid-471411409 could not be found. Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efa40e75-9b9a-4b32-af59-df93a406de09 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Request method failure captured: Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-471411409 HTTP/1.1 Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFz1KOFofVEUw3dqm-kQ7EN2Y0rjTBHnJ32Qk9XDnkqmjRBJtGGXssMxb0P8qAnt8uN-HSfrgZmW3EE4QknwfNqHA4Oud2mY2VlXbph-YEucMNL_sF2UXEbxlyImr5NQRRw82WlsroljQ05XaVHgC31mLzolDUBVG98FEMl5cJfp9LcQ Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:30:02.948372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/390efc66a4a54d33ad682e3022524588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_390efc66a4a54d33ad682e3022524588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}] Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: f7925d08c85a404bbe6cba11ac339da4 Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Volume tempest-invalid-471411409 could not be found. Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'tempest-invalid-471411409'} Sep 06 12:30:02.949964 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-471411409 could not be found. (HTTP 404) (Request-ID: req-db10bb03-2924-4bb8-a0a4-35d54ac494da) Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.951076 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 12:30:02.952383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-471411409 could not be found. Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:30:02.953684 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-471411409 could not be found. Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-471411409 could not be found. Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-efa40e75-9b9a-4b32-af59-df93a406de09 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Returning 404 to user: Volume tempest-invalid-471411409 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-efa40e75-9b9a-4b32-af59-df93a406de09 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-471411409" status: 404 len: 98 microversion: 2.1 time: 0.036862 Sep 06 12:30:02.955066 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2412/4806] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Sep 6 12:30:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-471411409 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 12:30:02.963235 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d92a3a1f-bb6a-4d13-ae54-9d1a1b534a61 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006004 Sep 06 12:30:02.963744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2395/4807] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Sep 6 12:30:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 12:30:02.972586 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-871068e3-2e40-4394-9b32-dc02c6344be1 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004186 Sep 06 12:30:02.973108 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2413/4808] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Sep 6 12:30:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 12:30:02.981916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cfa276a2-6a36-41f2-ae01-0da79da899fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Calling method '.version_select at 0x7f97f86de5e0>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:03.011526 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-cfa276a2-6a36-41f2-ae01-0da79da899fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] HTTP exception thrown: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cfa276a2-6a36-41f2-ae01-0da79da899fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Request method failure captured: Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: DELETE /compute/v2.1/os-volumes/98c61109-4cb6-4721-b4be-722004c0805a HTTP/1.1 Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz1KOFofVEUw3dqm-kQ7EN2Y0rjTBHnJ32Qk9XDnkqmjRBJtGGXssMxb0P8qAnt8uN-HSfrgZmW3EE4QknwfNqHA4Oud2mY2VlXbph-YEucMNL_sF2UXEbxlyImr5NQRRw82WlsroljQ05XaVHgC31mLzolDUBVG98FEMl5cJfp9LcQ Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:30:03.013541 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/390efc66a4a54d33ad682e3022524588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_390efc66a4a54d33ad682e3022524588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}] Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: f7925d08c85a404bbe6cba11ac339da4 Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '98c61109-4cb6-4721-b4be-722004c0805a'} Sep 06 12:30:03.015100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. (HTTP 404) (Request-ID: req-e3463780-49ad-40de-9d75-18f12b7da449) Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:03.015966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 12:30:03.017273 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 12:30:03.019275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-cfa276a2-6a36-41f2-ae01-0da79da899fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Returning 404 to user: Volume 98c61109-4cb6-4721-b4be-722004c0805a could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-cfa276a2-6a36-41f2-ae01-0da79da899fa tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/98c61109-4cb6-4721-b4be-722004c0805a" status: 404 len: 109 microversion: 2.1 time: 0.036809 Sep 06 12:30:03.020766 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2396/4809] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:30:02 2022] DELETE /compute/v2.1/os-volumes/98c61109-4cb6-4721-b4be-722004c0805a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:30:03.025928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5047d40-c26b-4d36-a701-3f1912c31171 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Calling method '.version_select at 0x7f97f499d790>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:03.057332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-d5047d40-c26b-4d36-a701-3f1912c31171 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] HTTP exception thrown: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5047d40-c26b-4d36-a701-3f1912c31171 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Request method failure captured: Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/os-volumes/8a38a2a8-d09b-4106-9426-d87d29d29e27 HTTP/1.1 Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFz1KOFofVEUw3dqm-kQ7EN2Y0rjTBHnJ32Qk9XDnkqmjRBJtGGXssMxb0P8qAnt8uN-HSfrgZmW3EE4QknwfNqHA4Oud2mY2VlXbph-YEucMNL_sF2UXEbxlyImr5NQRRw82WlsroljQ05XaVHgC31mLzolDUBVG98FEMl5cJfp9LcQ Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:30:03.059386 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/390efc66a4a54d33ad682e3022524588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_390efc66a4a54d33ad682e3022524588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/390efc66a4a54d33ad682e3022524588"}]}] Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 390efc66a4a54d33ad682e3022524588 Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesNegativeTest-2072293241 Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: f7925d08c85a404bbe6cba11ac339da4 Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesNegativeTest-2072293241-project Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '8a38a2a8-d09b-4106-9426-d87d29d29e27'} Sep 06 12:30:03.060920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. (HTTP 404) (Request-ID: req-b0f540d6-650d-4f03-9fe8-e2b6d1fc08c1) Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:03.061803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:30:03.062971 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 12:30:03.064131 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d5047d40-c26b-4d36-a701-3f1912c31171 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] Returning 404 to user: Volume 8a38a2a8-d09b-4106-9426-d87d29d29e27 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d5047d40-c26b-4d36-a701-3f1912c31171 tempest-VolumesNegativeTest-2072293241 tempest-VolumesNegativeTest-2072293241-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8a38a2a8-d09b-4106-9426-d87d29d29e27" status: 404 len: 109 microversion: 2.1 time: 0.039852 Sep 06 12:30:03.065210 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2414/4810] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:30:03 2022] GET /compute/v2.1/os-volumes/8a38a2a8-d09b-4106-9426-d87d29d29e27 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:30:03.163586 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:03.164206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:03.166123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:30:03.172446 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:03.173036 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:03.173569 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:03.174399 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:03.175024 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:03.175592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:03.314095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:30:03.322145 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9ee752eb-2a65-4075-ad0e-97ad75d5c63a tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1464 microversion: 2.1 time: 0.163072 Sep 06 12:30:03.322638 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2397/4811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:03 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:03.373403 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:03.373928 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:03.381242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:03.381765 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:03.382208 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:03.383124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:03.383360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:03.383787 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:03.410048 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:30:03.493254 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-9129c989-a491-443b-87e8-16d8123e25f7 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 204 len: 0 microversion: 2.1 time: 0.124139 Sep 06 12:30:03.493889 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2415/4812] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:30:03 2022] DELETE /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:30:03.502653 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:03.503483 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:03.512729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:03.513219 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:03.514054 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:03.514941 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:03.515401 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:03.516205 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:03.703532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:30:03.712484 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d29cac59-042a-409e-967f-90ed972ceb49 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1470 microversion: 2.1 time: 0.213873 Sep 06 12:30:03.713105 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2398/4813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:03 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:04.737463 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:04.738458 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:04.740876 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:30:04.746296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:04.746790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:04.747226 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:04.747920 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:04.748372 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:04.748833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:05.134631 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:30:05.143001 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8d654c45-b068-4ce8-ad1e-76def640280c tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1470 microversion: 2.1 time: 0.410514 Sep 06 12:30:05.143583 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2416/4814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:04 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1470 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:05.684735 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-159c706a-d5f5-47c6-bb3b-4deb8ed529ac req-8b7c6cd4-cee1-4b1a-ab1e-faa84500bfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a9f4f-aff8-4fc3-a971-cc7bd166f508", "name": "network-vif-deleted", "tag": "e917ba9e-4aeb-4d51-9c23-6e8904d4d904"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:30:05.696643 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-159c706a-d5f5-47c6-bb3b-4deb8ed529ac req-8b7c6cd4-cee1-4b1a-ab1e-faa84500bfdf service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:05.697265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-159c706a-d5f5-47c6-bb3b-4deb8ed529ac req-8b7c6cd4-cee1-4b1a-ab1e-faa84500bfdf service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:05.697771 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-159c706a-d5f5-47c6-bb3b-4deb8ed529ac req-8b7c6cd4-cee1-4b1a-ab1e-faa84500bfdf service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:05.720568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-159c706a-d5f5-47c6-bb3b-4deb8ed529ac req-8b7c6cd4-cee1-4b1a-ab1e-faa84500bfdf service nova] Creating event network-vif-deleted:e917ba9e-4aeb-4d51-9c23-6e8904d4d904 for instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 on hv-cinder-85604 Sep 06 12:30:05.725702 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-159c706a-d5f5-47c6-bb3b-4deb8ed529ac req-8b7c6cd4-cee1-4b1a-ab1e-faa84500bfdf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044569 Sep 06 12:30:05.726366 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2399/4815] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:30:06.169432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:06.170073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:06.176378 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:06.177387 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:06.177890 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:06.178503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:06.178950 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:06.179366 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:06.211782 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:06.212260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:06.212688 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:06.213123 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.objects.instance [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lazy-loading 'fault' on Instance uuid 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 {{(pid=127122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:30:06.266480 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71dcf98c074847158fabdb71a7594902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fe7ddc88334bc6a7912c5fa07b9516', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:30:06.275209 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7ce02b0a-b1d2-49ff-9adb-8cac72b2f1e3 tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 200 len: 1305 microversion: 2.1 time: 0.111760 Sep 06 12:30:06.275807 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2417/4816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:06 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:30:07.300152 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:30:07.300856 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] [instance: 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:30:07.307672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:07.308161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:07.308597 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:07.309287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:30:07.309784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:30:07.310217 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:30:07.323465 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] HTTP exception thrown: Instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 could not be found. Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Request method failure captured: Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 HTTP/1.1 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz07qYrEzuFyG8f10UmRJg46RkztV2FSCXq14-SJYk8RkLCLL01-JqOb-Pn9hH4QLTgpZcaHxFfUwG5Bd_7StuUghl8nChVT7oEW2YrXsx6c5_5MYM45APHQPt2bl_Eq3UELfpctxYuF_qC8iHKsL7x2tR0Bp3EeW1p5aCWwM7q65g8 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 26fe7ddc88334bc6a7912c5fa07b9516 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesNegativeTest-567736505 Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:30:07.325099 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/26fe7ddc88334bc6a7912c5fa07b9516"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/26fe7ddc88334bc6a7912c5fa07b9516"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_26fe7ddc88334bc6a7912c5fa07b9516"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/26fe7ddc88334bc6a7912c5fa07b9516"}]}] Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesNegativeTest-567736505 Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 26fe7ddc88334bc6a7912c5fa07b9516 Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesNegativeTest-567736505 Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesNegativeTest-567736505-project Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 71dcf98c074847158fabdb71a7594902 Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesNegativeTest-567736505-project Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 could not be found. Sep 06 12:30:07.326684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '8d9a9f4f-aff8-4fc3-a971-cc7bd166f508'} Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 could not be found. Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:30:07.327516 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 could not be found. Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 could not be found. Sep 06 12:30:07.328727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:30:07.330203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] Returning 404 to user: Instance 8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:30:07.330203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9481344-9085-4fde-a34c-2a6911e8c42e tempest-VolumesNegativeTest-567736505 tempest-VolumesNegativeTest-567736505-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508" status: 404 len: 111 microversion: 2.1 time: 0.031103 Sep 06 12:30:07.330203 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2400/4817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:30:07 2022] GET /compute/v2.1/servers/8d9a9f4f-aff8-4fc3-a971-cc7bd166f508 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:32:09.022690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c439015-29a7-4d5a-9f87-ef7693d37ebc] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 12:32:09.029487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=5 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:09.032484 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:09.033859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:32:09.034430 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:32:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Sep 06 12:32:09.035963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:32:09.036230 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:32:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Sep 06 12:32:09.283417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-cfe71232-98cc-4e3a-b358-aad1eebf0cfa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Action: 'create', calling method: .version_select at 0x7f97f8731b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2082497120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6fwGsDfkCwFQNBQCzbABYbVruecwtMDDBdVJDGnB1Q3TWtS7MsiFcS5hFZnx/8i0JxY3CwbpALk/XZh2MrSYTMB+k2AFpSQJJHIPavWyaa/MkubxsT1yKhAA992eYe3A=="}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:32:09.300412 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-cfe71232-98cc-4e3a-b358-aad1eebf0cfa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Getting quotas for project 4e13494666564124bdf4007277a515d6. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:32:09.304391 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.quota [None req-cfe71232-98cc-4e3a-b358-aad1eebf0cfa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Getting quotas for user 1102506cce6d4bd68d1af92fa8811fe3 and project 4e13494666564124bdf4007277a515d6. Resources: {'key_pairs'} {{(pid=127122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:32:09.336845 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-cfe71232-98cc-4e3a-b358-aad1eebf0cfa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.343051 Sep 06 12:32:09.343904 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2418/4818] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 6 12:32:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:32:32.009328 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=7 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:32.010111 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=56 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:32.011307 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:32:32.011491 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 06 12:32:32.012814 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:32:32.012939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Sep 06 12:32:32.020064 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-335788444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2082497120", "security_groups": [{"name": "tempest-secgroup-smoke-403162106"}], "networks": [{"uuid": "3a0a9b07-00ac-46e5-bee5-6e3cb0d8524e"}], "block_device_mapping_v2": [{"uuid": "78bd34d1-27ae-472e-b0be-d1acc1001a87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:32:32.138795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.network.neutron [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] validate_networks() for [('3a0a9b07-00ac-46e5-bee5-6e3cb0d8524e', None, None, None, None, None)] {{(pid=127121) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 12:32:32.857916 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Flavor limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 12:32:32.858340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Image limits 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 12:32:32.858810 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Flavor pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 12:32:32.859215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Image pref 0:0:0 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 12:32:32.860171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.virt.hardware [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 12:32:32.868748 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:32.869227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:32.869672 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:32.870409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:32.870881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:32.871282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:32.888692 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Getting quotas for project 4e13494666564124bdf4007277a515d6. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 12:32:32.893905 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.quota [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Getting quotas for user 1102506cce6d4bd68d1af92fa8811fe3 and project 4e13494666564124bdf4007277a515d6. Resources: {'instances', 'ram', 'cores'} {{(pid=127121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 12:32:32.951538 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Going to run 1 instances... {{(pid=127121) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 12:32:32.954267 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78bd34d1-27ae-472e-b0be-d1acc1001a87',volume_size=None,volume_type=None)] {{(pid=127121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 12:32:33.092614 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e33bb95d-ecab-461a-b856-5ee610c645df tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.085106 Sep 06 12:32:33.093542 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2401/4819] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 6 12:32:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 12:32:33.104417 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-99db261c-48d8-4f2c-8bbc-69f0e69df02d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:33.105054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-99db261c-48d8-4f2c-8bbc-69f0e69df02d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:33.108212 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:33.109050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:33.127697 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c439015-29a7-4d5a-9f87-ef7693d37ebc] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60364. Sep 06 12:32:33.179113 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-99db261c-48d8-4f2c-8bbc-69f0e69df02d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:33.187519 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-99db261c-48d8-4f2c-8bbc-69f0e69df02d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1088 microversion: 2.1 time: 0.086826 Sep 06 12:32:33.188785 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2419/4820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:33 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:34.212143 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:34.212744 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:34.220787 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:34.221279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:34.221752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:34.222459 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:34.222917 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:34.223342 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:34.300959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:34.308943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e6487ed3-5d34-40c6-9a1d-16193f90d716 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1194 microversion: 2.1 time: 0.101887 Sep 06 12:32:34.309616 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2402/4821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:34 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:35.334146 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:35.334727 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:35.341802 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:35.342183 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:35.342803 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:35.343523 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:35.344759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:35.345288 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:35.579078 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:35.587662 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-984782f2-b19b-44ed-87f8-2b2ae95a089f tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.257588 Sep 06 12:32:35.588181 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2420/4822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:35 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:32:35.835277 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-89dda8dc-4e5a-4c1e-902e-db54ce89e783 req-6af4ac0e-6214-43c6-b6df-81abb11db9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:32:35.852252 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-89dda8dc-4e5a-4c1e-902e-db54ce89e783 req-6af4ac0e-6214-43c6-b6df-81abb11db9bd service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:35.852657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-89dda8dc-4e5a-4c1e-902e-db54ce89e783 req-6af4ac0e-6214-43c6-b6df-81abb11db9bd service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:35.853097 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-89dda8dc-4e5a-4c1e-902e-db54ce89e783 req-6af4ac0e-6214-43c6-b6df-81abb11db9bd service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:35.865438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-89dda8dc-4e5a-4c1e-902e-db54ce89e783 req-6af4ac0e-6214-43c6-b6df-81abb11db9bd service nova] Creating event network-changed:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:32:35.870425 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-89dda8dc-4e5a-4c1e-902e-db54ce89e783 req-6af4ac0e-6214-43c6-b6df-81abb11db9bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038867 Sep 06 12:32:35.871206 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2403/4823] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:32:36.610424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:36.611032 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:36.617360 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:36.617873 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:36.618310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:36.618998 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:36.619450 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:36.619878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:36.756809 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:36.765268 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-8bda2c9a-0378-47c8-8bbb-bb11e1ada2e4 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.158739 Sep 06 12:32:36.766672 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2421/4824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:36 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:37.790306 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:37.791069 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:37.798818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:37.799333 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:37.799772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:37.800480 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:37.800937 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:37.801362 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:37.936493 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:37.944670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-dab97b70-ccee-4220-8a76-ed2cc7a849fa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.159900 Sep 06 12:32:37.945228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2404/4825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:37 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:38.968251 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:38.969600 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:38.976192 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:38.976678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:38.977118 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:38.977851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:38.978311 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:38.978739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:39.118434 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:39.126266 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f526179f-02ce-42fa-80e4-8e75bf861576 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.161904 Sep 06 12:32:39.126833 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2422/4826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:38 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:40.149809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:40.150498 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:40.157039 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:40.157510 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:40.157977 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:40.158658 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:40.159114 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:40.159532 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:40.300298 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:40.308458 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-ba280445-02f0-4701-b1aa-436305f233e9 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.162503 Sep 06 12:32:40.309032 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2405/4827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:40 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:41.332813 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:41.333432 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:41.339832 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:41.340322 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:41.340757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:41.341447 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:41.341937 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:41.342365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:41.474864 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:41.482578 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2a294d6a-e326-412d-9574-17a596eeb423 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.153637 Sep 06 12:32:41.483155 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2423/4828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:41 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:42.506680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:42.507402 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:42.514191 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:42.514680 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:42.515119 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:42.516449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:42.517006 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:42.517438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:42.647345 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:42.655215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-557b78d2-fc46-4427-95af-bc5924d9a894 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.152432 Sep 06 12:32:42.655777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2406/4829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:42 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:43.678394 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:43.679015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:43.681392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell0:SELECT=2 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:43.686962 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:43.688433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:43.688878 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:43.689574 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:43.690064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:43.690492 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:43.825148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:43.833100 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-303dd381-2d6d-457a-b2e4-b63d6a13d79e tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.158617 Sep 06 12:32:43.833682 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2424/4830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:43 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:44.856769 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:44.857295 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:44.859582 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=2 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:44.859983 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell0:SELECT=6 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:44.867046 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:44.867534 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:44.867965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:44.868662 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:44.869121 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:44.869548 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:45.011690 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:45.019896 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-0c0db202-8610-4005-8098-fcea5fd059d6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.167139 Sep 06 12:32:45.020547 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2407/4831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:44 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:46.043299 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:46.043922 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:46.051509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:46.052002 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:46.052437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:46.053253 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:46.053612 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:46.054070 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:46.190245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:46.198088 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-57800c63-ed76-4111-9f18-d356ac8736fb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.158664 Sep 06 12:32:46.198658 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2425/4832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:46 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:47.221080 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:47.221955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:47.230073 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:47.230567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:47.231007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:47.231714 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:47.232172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:47.232607 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:47.406831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:47.416770 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-104c1701-bf5a-434d-bada-484e675c0611 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.200234 Sep 06 12:32:47.417367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2408/4833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:47 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:47.424365 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-78dd33ff-a78c-4bac-a810-bd7386e4757a req-23577e1d-167e-45a7-9963-2535a259601b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "name": "network-vif-plugged", "status": "completed", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:32:47.434821 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-78dd33ff-a78c-4bac-a810-bd7386e4757a req-23577e1d-167e-45a7-9963-2535a259601b service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:47.435491 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-78dd33ff-a78c-4bac-a810-bd7386e4757a req-23577e1d-167e-45a7-9963-2535a259601b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:47.435952 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-78dd33ff-a78c-4bac-a810-bd7386e4757a req-23577e1d-167e-45a7-9963-2535a259601b service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:47.448509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-78dd33ff-a78c-4bac-a810-bd7386e4757a req-23577e1d-167e-45a7-9963-2535a259601b service nova] Creating event network-vif-plugged:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:32:47.454543 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-78dd33ff-a78c-4bac-a810-bd7386e4757a req-23577e1d-167e-45a7-9963-2535a259601b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034226 Sep 06 12:32:47.455148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2426/4834] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:32:48.439752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:48.440274 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:48.446667 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:48.447153 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:48.447593 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:48.448282 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:48.448740 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:48.449169 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:48.583755 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:48.591601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-79055d67-2b66-4aa4-8cb2-64ccb308aafa tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1259 microversion: 2.1 time: 0.156436 Sep 06 12:32:48.592196 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2409/4835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:48 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:49.614721 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:49.615346 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:49.621607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:49.622124 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:49.624705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:49.624705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:49.624705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:49.624705 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:49.762398 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:49.770861 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7286e330-8e96-44d4-874f-42464d87f0f6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1442 microversion: 2.1 time: 0.161123 Sep 06 12:32:49.771433 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2427/4836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:49 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:49.792939 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:32:49.793544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:32:49.800293 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:49.800777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:49.801234 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:49.802020 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:49.802478 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:49.802899 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:49.938708 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:32:49.946378 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c6deb0e1-dc52-4d91-a9be-d53de3f25b8d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1442 microversion: 2.1 time: 0.157319 Sep 06 12:32:49.946943 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2410/4837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:32:49 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:32:51.606315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-9c0f445a-0e9b-4a20-9149-415b7a0f5757 req-8e16ce3b-3e6d-4666-8d7a-9897730450a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:32:51.616611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-9c0f445a-0e9b-4a20-9149-415b7a0f5757 req-8e16ce3b-3e6d-4666-8d7a-9897730450a7 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:32:51.617168 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-9c0f445a-0e9b-4a20-9149-415b7a0f5757 req-8e16ce3b-3e6d-4666-8d7a-9897730450a7 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:32:51.617615 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-9c0f445a-0e9b-4a20-9149-415b7a0f5757 req-8e16ce3b-3e6d-4666-8d7a-9897730450a7 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:32:51.629424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-9c0f445a-0e9b-4a20-9149-415b7a0f5757 req-8e16ce3b-3e6d-4666-8d7a-9897730450a7 service nova] Creating event network-changed:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:32:51.634844 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-9c0f445a-0e9b-4a20-9149-415b7a0f5757 req-8e16ce3b-3e6d-4666-8d7a-9897730450a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032111 Sep 06 12:32:51.635567 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2428/4838] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:04.252839 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:04.253343 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:33:04.255391 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:04.256226 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=52 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:04.262467 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:04.262965 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:04.263409 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:04.264117 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:04.264599 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:04.265031 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:04.283777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] HTTP exception thrown: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Request method failure captured: Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: DELETE /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 HTTP/1.1 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzPv0WtLeLqEDxmjmkzHLSMUmkE09JJ1VVVwZVSBDR9kNuTQ3_WMYwe7dEsotKOdoT2epiGF-jLwJDj0b5SJnHlS5ywBsZT7K8YyhLJf1gydCpM4pXSsnIhwlaGOrAwwhBcVVO_D1t0iNa3UsfRMSaDwZgHxxpOXhkThFjbqudFGNcI Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:33:04.285475 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a896d72b5b00477d855131345711c748"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a896d72b5b00477d855131345711c748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}] Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e235718ad1da42ebb209fb4b13626ff1 Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.286947 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '1f3e3706-8f24-400d-889c-3cd946e70e71'} Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:04.287890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.289506 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.291224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Returning 404 to user: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:04.291224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-f9187e38-a3df-4cb7-90cb-2404272d1baf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 404 len: 111 microversion: 2.20 time: 0.038820 Sep 06 12:33:04.291224 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2411/4839] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 6 12:33:04 2022] DELETE /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:33:04.293408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=22 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:04.294184 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=46 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:04.299044 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:04.299753 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 1f3e3706-8f24-400d-889c-3cd946e70e71] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:33:04.306606 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:04.307092 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:04.307517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:04.308196 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:04.308650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:04.309075 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:04.322407 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] HTTP exception thrown: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Request method failure captured: Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 HTTP/1.1 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzPv0WtLeLqEDxmjmkzHLSMUmkE09JJ1VVVwZVSBDR9kNuTQ3_WMYwe7dEsotKOdoT2epiGF-jLwJDj0b5SJnHlS5ywBsZT7K8YyhLJf1gydCpM4pXSsnIhwlaGOrAwwhBcVVO_D1t0iNa3UsfRMSaDwZgHxxpOXhkThFjbqudFGNcI Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:33:04.324051 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a896d72b5b00477d855131345711c748"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a896d72b5b00477d855131345711c748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}] Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e235718ad1da42ebb209fb4b13626ff1 Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.325839 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '1f3e3706-8f24-400d-889c-3cd946e70e71'} Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:04.326827 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. Sep 06 12:33:04.328012 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:04.329749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Returning 404 to user: Instance 1f3e3706-8f24-400d-889c-3cd946e70e71 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:04.329749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f4aadc24-ed39-4ba6-901f-ad59827cfbbf tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71" status: 404 len: 111 microversion: 2.20 time: 0.033586 Sep 06 12:33:04.329749 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2429/4840] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:33:04 2022] GET /compute/v2.1/servers/1f3e3706-8f24-400d-889c-3cd946e70e71 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:33:05.475357 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:05.476000 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:33:05.482201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:05.482684 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:05.483113 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:05.483795 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:05.484245 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:05.484668 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:05.498887 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] HTTP exception thrown: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Request method failure captured: Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 HTTP/1.1 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFzPv0WtLeLqEDxmjmkzHLSMUmkE09JJ1VVVwZVSBDR9kNuTQ3_WMYwe7dEsotKOdoT2epiGF-jLwJDj0b5SJnHlS5ywBsZT7K8YyhLJf1gydCpM4pXSsnIhwlaGOrAwwhBcVVO_D1t0iNa3UsfRMSaDwZgHxxpOXhkThFjbqudFGNcI Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:33:05.500448 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a896d72b5b00477d855131345711c748"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a896d72b5b00477d855131345711c748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}] Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: e235718ad1da42ebb209fb4b13626ff1 Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.502165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '0878a748-0471-4506-b2e8-7b3d85289c54'} Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:05.503840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.505280 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.506567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Returning 404 to user: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:05.506567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c1820b43-76e6-4f6c-beaa-2c4dc2f25221 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 404 len: 111 microversion: 2.20 time: 0.030832 Sep 06 12:33:05.506567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2412/4841] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 6 12:33:05 2022] DELETE /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:33:05.510690 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:05.511310 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] [instance: 0878a748-0471-4506-b2e8-7b3d85289c54] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:33:05.518037 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:05.518522 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:05.518970 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:05.519665 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:33:05.520126 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:33:05.520553 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:33:05.534771 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] HTTP exception thrown: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Request method failure captured: Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 HTTP/1.1 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFzPv0WtLeLqEDxmjmkzHLSMUmkE09JJ1VVVwZVSBDR9kNuTQ3_WMYwe7dEsotKOdoT2epiGF-jLwJDj0b5SJnHlS5ywBsZT7K8YyhLJf1gydCpM4pXSsnIhwlaGOrAwwhBcVVO_D1t0iNa3UsfRMSaDwZgHxxpOXhkThFjbqudFGNcI Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:33:05.536333 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a896d72b5b00477d855131345711c748"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a896d72b5b00477d855131345711c748"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a896d72b5b00477d855131345711c748"}]}] Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: a896d72b5b00477d855131345711c748 Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-271055620 Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: e235718ad1da42ebb209fb4b13626ff1 Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-271055620-project Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: > Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.538093 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': '0878a748-0471-4506-b2e8-7b3d85289c54'} Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:05.538859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. Sep 06 12:33:05.540015 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:05.541054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] Returning 404 to user: Instance 0878a748-0471-4506-b2e8-7b3d85289c54 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:05.541054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b8aeae40-8938-4442-bf23-edd679ca76a2 tempest-AttachVolumeShelveTestJSON-271055620 tempest-AttachVolumeShelveTestJSON-271055620-project] 10.222.0.18 "GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54" status: 404 len: 111 microversion: 2.20 time: 0.030877 Sep 06 12:33:05.541054 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2430/4842] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 6 12:33:05 2022] GET /compute/v2.1/servers/0878a748-0471-4506-b2e8-7b3d85289c54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 12:33:10.262193 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-5d8ab77b-042e-4857-b503-fa0c3c7d1345 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Action: 'create', calling method: .version_select at 0x7f97f4e2eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1500203532"}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:33:10.554332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-5d8ab77b-042e-4857-b503-fa0c3c7d1345 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.431219 Sep 06 12:33:10.554981 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2413/4843] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Sep 6 12:33:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 433 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 12:33:10.567593 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-7e6b16cc-fc41-4dde-a9c8-af662587a276 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f499dee0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:10.620828 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-7e6b16cc-fc41-4dde-a9c8-af662587a276 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 200 len: 345 microversion: 2.1 time: 0.056872 Sep 06 12:33:10.621769 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2431/4844] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:33:10 2022] GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:11.636913 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2480ea76-8e29-4fd9-a6ce-cb30b8ffc729 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f8681820>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:11.685610 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2480ea76-8e29-4fd9-a6ce-cb30b8ffc729 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 200 len: 346 microversion: 2.1 time: 0.053022 Sep 06 12:33:11.686225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2414/4845] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:33:11 2022] GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:11.700149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6e274c3b-51e0-481a-b2ac-bdc7b3f68380 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Action: 'create', calling method: .version_select at 0x7f97f4f398b0>, body: {"snapshot": {"volume_id": "d47e5638-5ae1-4d68-b3e0-89182e00c2b5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-443953910"}} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:33:11.856045 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6e274c3b-51e0-481a-b2ac-bdc7b3f68380 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160168 Sep 06 12:33:11.856636 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2432/4846] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Sep 6 12:33:11 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:11.868745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b82c3b2d-0f09-43d8-b095-03ce8272b553 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f4e2ed30>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:11.906318 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b82c3b2d-0f09-43d8-b095-03ce8272b553 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.041978 Sep 06 12:33:11.906897 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2415/4847] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:11 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:11.917871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b7eac237-9224-4c79-aef5-b2585c69c94d tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f865ae50>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:11.949262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b7eac237-9224-4c79-aef5-b2585c69c94d tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035097 Sep 06 12:33:11.950176 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2433/4848] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Sep 6 12:33:11 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:11.962422 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-e00b4831-2015-4518-be3c-ebe99d75c796 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f5345c10>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:11.993521 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-e00b4831-2015-4518-be3c-ebe99d75c796 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.034983 Sep 06 12:33:11.994698 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2416/4849] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:11 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:13.007560 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-965c15ba-8c72-4357-8ae8-63001e890a17 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f4f390d0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:13.039759 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-965c15ba-8c72-4357-8ae8-63001e890a17 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.036488 Sep 06 12:33:13.040332 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2434/4850] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:13 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 12:33:14.053065 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-84af1e48-eedb-4264-9de3-80407ad51d8b tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f503f430>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:14.083655 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-84af1e48-eedb-4264-9de3-80407ad51d8b tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.034935 Sep 06 12:33:14.084231 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2417/4851] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:14 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:15.098489 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c706d6b-d275-431e-aa01-11d8aa02dcfc tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f4ed2d30>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:15.131039 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c706d6b-d275-431e-aa01-11d8aa02dcfc tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.038253 Sep 06 12:33:15.131881 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2435/4852] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:15 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:16.140923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:16.141762 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=4 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:16.146524 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-2057879d-503d-47d1-b0f1-bb363f82da0f tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f4e2e040>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:16.180018 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-2057879d-503d-47d1-b0f1-bb363f82da0f tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.040259 Sep 06 12:33:16.180589 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2418/4853] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:16 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:17.193199 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-6331aee5-c667-409f-924e-2761ba07133c tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f862b040>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:17.199297 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:17.200026 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=4 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:33:17.226598 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-6331aee5-c667-409f-924e-2761ba07133c tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 287 microversion: 2.1 time: 0.037647 Sep 06 12:33:17.227169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2436/4854] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:17 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:17.239535 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-8fe88a0a-4596-4522-b572-67a6b28672be tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f4f2c700>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:17.304482 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-8fe88a0a-4596-4522-b572-67a6b28672be tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 202 len: 0 microversion: 2.1 time: 0.069306 Sep 06 12:33:17.309275 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2419/4855] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Sep 6 12:33:17 2022] DELETE /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:33:17.318213 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a529ef41-bdb9-4ae5-bee9-bd7a41805937 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f497f790>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:17.348499 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a529ef41-bdb9-4ae5-bee9-bd7a41805937 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 200 len: 286 microversion: 2.1 time: 0.034824 Sep 06 12:33:17.349096 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2437/4856] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:17 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:18.362003 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f8e158a-02c5-48df-9475-e35a92a09b81 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f8762550>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:18.387013 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-9f8e158a-02c5-48df-9475-e35a92a09b81 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] HTTP exception thrown: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f8e158a-02c5-48df-9475-e35a92a09b81 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Request method failure captured: Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 HTTP/1.1 Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz4Gx5y0FhWztFI_mGrUpRzykpZdeBePw4HPQVKlgI4r0XHzb1frIrfIa2xFQFY2Hl7i_XhV7gzkd_RFnnCG5srFqzg7BvgKrFfn_QgIEHWsb73TCBYrT5YjY2SN7Kf020EG_prZa4jWFzoz0ZQaSLtFarb_CUlFarbSFVsivv2TkXk Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:33:18.389256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}] Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 4e1b84022d544fe08f4e85596c195ba4 Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': 'e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4'} Sep 06 12:33:18.390858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. (HTTP 404) (Request-ID: req-9ce21848-10ae-49d3-af77-8f5ef030842d) Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.391804 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:33:18.394227 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 12:33:18.395870 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-9f8e158a-02c5-48df-9475-e35a92a09b81 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Returning 404 to user: Snapshot e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:18.397300 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-9f8e158a-02c5-48df-9475-e35a92a09b81 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4" status: 404 len: 111 microversion: 2.1 time: 0.033231 Sep 06 12:33:18.398784 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2420/4857] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 6 12:33:18 2022] GET /compute/v2.1/os-snapshots/e89ebd9b-6e9e-4a74-b9f0-2a6770e8aea4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:33:18.400408 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-63667b8d-81db-41a9-add8-6c2f66615302 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f53008b0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:18.462774 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-63667b8d-81db-41a9-add8-6c2f66615302 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 202 len: 0 microversion: 2.1 time: 0.066592 Sep 06 12:33:18.463353 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2438/4858] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:33:18 2022] DELETE /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:33:18.472007 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-16f761ec-2577-4a03-b478-e761bebc8436 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f8681160>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:18.526100 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-16f761ec-2577-4a03-b478-e761bebc8436 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 200 len: 345 microversion: 2.1 time: 0.058110 Sep 06 12:33:18.526715 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2421/4859] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:33:18 2022] GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:33:19.542282 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9adb091-e483-4c85-acd1-8583c5d648b6 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f497f310>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:19.570571 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-d9adb091-e483-4c85-acd1-8583c5d648b6 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] HTTP exception thrown: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9adb091-e483-4c85-acd1-8583c5d648b6 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Request method failure captured: Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 HTTP/1.1 Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFz4Gx5y0FhWztFI_mGrUpRzykpZdeBePw4HPQVKlgI4r0XHzb1frIrfIa2xFQFY2Hl7i_XhV7gzkd_RFnnCG5srFqzg7BvgKrFfn_QgIEHWsb73TCBYrT5YjY2SN7Kf020EG_prZa4jWFzoz0ZQaSLtFarb_CUlFarbSFVsivv2TkXk Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:33:19.572611 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}] Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 4e1b84022d544fe08f4e85596c195ba4 Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'd47e5638-5ae1-4d68-b3e0-89182e00c2b5'} Sep 06 12:33:19.574195 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. (HTTP 404) (Request-ID: req-0147e03a-4c8f-47c1-b69e-ac024bc4957c) Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.575234 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:33:19.576653 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 12:33:19.578067 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-d9adb091-e483-4c85-acd1-8583c5d648b6 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Returning 404 to user: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-d9adb091-e483-4c85-acd1-8583c5d648b6 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 404 len: 109 microversion: 2.1 time: 0.036234 Sep 06 12:33:19.579623 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2439/4860] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:33:19 2022] GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:33:19.588621 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-abbc378e-4335-4a7f-af2d-f9044aca4583 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f4e2eb80>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:19.617479 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-abbc378e-4335-4a7f-af2d-f9044aca4583 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] HTTP exception thrown: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-abbc378e-4335-4a7f-af2d-f9044aca4583 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Request method failure captured: Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: DELETE /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 HTTP/1.1 Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz4Gx5y0FhWztFI_mGrUpRzykpZdeBePw4HPQVKlgI4r0XHzb1frIrfIa2xFQFY2Hl7i_XhV7gzkd_RFnnCG5srFqzg7BvgKrFfn_QgIEHWsb73TCBYrT5YjY2SN7Kf020EG_prZa4jWFzoz0ZQaSLtFarb_CUlFarbSFVsivv2TkXk Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:33:19.621452 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}] Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 4e1b84022d544fe08f4e85596c195ba4 Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': 'd47e5638-5ae1-4d68-b3e0-89182e00c2b5'} Sep 06 12:33:19.625131 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. (HTTP 404) (Request-ID: req-2bb55ae1-463d-43cd-9be7-40ed8967e488) Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.626567 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 12:33:19.628657 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 12:33:19.629955 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-abbc378e-4335-4a7f-af2d-f9044aca4583 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Returning 404 to user: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:19.631210 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-abbc378e-4335-4a7f-af2d-f9044aca4583 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 404 len: 109 microversion: 2.1 time: 0.039850 Sep 06 12:33:19.632130 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2422/4861] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 6 12:33:19 2022] DELETE /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:33:19.636713 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-12b34c5a-6b26-409f-9d88-a0fa4597ecf3 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Calling method '.version_select at 0x7f97f862b670>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:33:19.666165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.wsgi [None req-12b34c5a-6b26-409f-9d88-a0fa4597ecf3 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] HTTP exception thrown: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-12b34c5a-6b26-409f-9d88-a0fa4597ecf3 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Request method failure captured: Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: request: GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 HTTP/1.1 Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept: application/json Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Accept-Encoding: identity Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Connection: close Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Length: 0 Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Content-Type: application/json Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Host: 10.222.0.18 Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Openstack-System-Scope: None Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: User-Agent: python-urllib3/1.26.12 Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Auth-Token: gAAAAABjFz4Gx5y0FhWztFI_mGrUpRzykpZdeBePw4HPQVKlgI4r0XHzb1frIrfIa2xFQFY2Hl7i_XhV7gzkd_RFnnCG5srFqzg7BvgKrFfn_QgIEHWsb73TCBYrT5YjY2SN7Kf020EG_prZa4jWFzoz0ZQaSLtFarb_CUlFarbSFVsivv2TkXk Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Id: None Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Domain-Name: None Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Identity-Status: Confirmed Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Is-Admin-Project: True Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Id: default Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Domain-Name: Default Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Role: reader,member Sep 06 12:33:19.668169 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Roles: reader,member Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a5d42a3868944e38d3439b6b117ecad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a5d42a3868944e38d3439b6b117ecad"}]}] Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Id: 3a5d42a3868944e38d3439b6b117ecad Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1713632892 Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Id: default Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Domain-Name: Default Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Id: 4e1b84022d544fe08f4e85596c195ba4 Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1713632892-project Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: method: Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: exception: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: action_args: {'id': 'd47e5638-5ae1-4d68-b3e0-89182e00c2b5'} Sep 06 12:33:19.669866 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. (HTTP 404) (Request-ID: req-32d0052e-9d35-44d0-8d51-13957183fa80) Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.670940 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 12:33:19.672375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 12:33:19.673939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR nova.api.openstack.wsgi Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-12b34c5a-6b26-409f-9d88-a0fa4597ecf3 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] Returning 404 to user: Volume d47e5638-5ae1-4d68-b3e0-89182e00c2b5 could not be found. {{(pid=127122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-12b34c5a-6b26-409f-9d88-a0fa4597ecf3 tempest-VolumesSnapshotsTestJSON-1713632892 tempest-VolumesSnapshotsTestJSON-1713632892-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5" status: 404 len: 109 microversion: 2.1 time: 0.036749 Sep 06 12:33:19.675804 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2440/4862] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 6 12:33:19 2022] GET /compute/v2.1/os-volumes/d47e5638-5ae1-4d68-b3e0-89182e00c2b5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:35:29.165840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 12:35:29.166681 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:35:29.166826 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb/action (ip 10.222.0.18) !!! Sep 06 12:35:29.179377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:35:29.179938 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:29.187350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:29.187832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:29.188265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:29.188984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:29.189437 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:29.189898 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:29.212554 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.objects.instance [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lazy-loading 'flavor' on Instance uuid 7bea0b7c-c6df-4cec-8841-173860a5deeb {{(pid=127121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 12:35:29.286042 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a43af16f-cb38-43d4-9721-2826367d0392 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "POST /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb/action" status: 202 len: 0 microversion: 2.1 time: 0.121599 Sep 06 12:35:29.286694 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2423/4863] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 12:35:29 2022] POST /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:35:29.295401 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c439015-29a7-4d5a-9f87-ef7693d37ebc] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:35:29.296236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:35:29.296382 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb (ip 10.222.0.18) !!! Sep 06 12:35:29.298545 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:35:29.298668 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb (ip 10.222.0.18) !!! Sep 06 12:35:29.300395 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 12:35:29.300533 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: Tue Sep 6 12:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb (ip 10.222.0.18) !!! Sep 06 12:35:29.322437 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:29.323056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:29.330307 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:29.330793 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:29.331229 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:29.331930 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:29.332444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:29.332877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:29.631030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:29.639508 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-41a25c8b-fd82-40e7-9b4b-efbf212bca80 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.347943 Sep 06 12:35:29.640081 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2441/4864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:29 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:30.664656 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:30.665361 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:30.675225 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:30.675718 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:30.676172 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:30.676891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:30.677350 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:30.677816 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:30.681324 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33124. Sep 06 12:35:30.867377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:30.876292 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-06be6f86-d0f6-41d4-82d6-705f6a168146 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.217053 Sep 06 12:35:30.876858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2424/4865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:30 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:35:31.901290 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:31.901936 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:31.910988 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:31.911476 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:31.911913 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:31.912607 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:31.913064 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:31.913488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:31.916919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c439015-29a7-4d5a-9f87-ef7693d37ebc] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33132. Sep 06 12:35:32.049621 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:32.057348 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f26cfa02-9e8a-44fd-bc40-9497c997194d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.160200 Sep 06 12:35:32.057948 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2442/4866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:31 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:33.080809 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:33.081426 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:33.088060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:33.088545 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:33.088984 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:33.089707 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:33.090165 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:33.090592 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:33.229721 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:33.237848 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a845329-d79f-483a-9513-1d1546f87627 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.161148 Sep 06 12:35:33.238455 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2425/4867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:33 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:34.261132 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:34.261783 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:34.268339 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:34.268829 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:34.269271 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:34.270016 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:34.270479 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:34.270909 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:34.407242 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:34.414924 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-bbc75d22-8d4f-454c-9f34-fc89d8e1de5c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.157799 Sep 06 12:35:34.415506 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2443/4868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:34 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:35.440341 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:35.440935 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:35.447339 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:35.447818 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:35.448253 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:35.448945 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:35.449393 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:35.449855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:35.582859 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:35.590600 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-a0e6cb11-b72d-4d04-8b9a-8a1f0eae1961 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.155230 Sep 06 12:35:35.591180 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2426/4869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:35 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:36.615186 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:36.615824 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:36.622388 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:36.622880 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:36.623327 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:36.624315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:36.624509 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:36.624934 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:36.761838 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:36.769999 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-603531b6-5d0a-4a02-b7d5-3e48ab0012c5 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.159573 Sep 06 12:35:36.770577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2444/4870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:36 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:37.793751 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:37.794367 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:37.801250 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:37.801772 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:37.802214 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:37.802909 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:37.803369 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:37.803802 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:37.938175 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:37.945974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-602772f4-02f7-4054-9770-77fb86716745 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.156027 Sep 06 12:35:37.946553 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2427/4871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:37 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:38.970085 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:38.970734 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:38.977165 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:38.977667 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:38.978107 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:38.978795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:38.979255 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:38.979674 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:39.115224 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:39.123140 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-675539d5-85ba-4970-a075-02d43d9a98a6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.157941 Sep 06 12:35:39.123795 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2445/4872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:38 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:40.147286 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:40.147891 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:40.154544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:40.155858 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:40.156631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:40.157340 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:40.157830 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:40.158270 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:40.294966 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:40.302812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-fa931e4c-f1e4-4fa8-9d46-ffb5a11a45cb tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.159408 Sep 06 12:35:40.303902 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2428/4873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:40 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:41.326264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:41.327375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:41.333919 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:41.334399 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:41.334834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:41.335512 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:41.335963 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:41.336383 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:41.476569 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:41.485245 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-522f7a54-9ebb-4f1a-8585-5179cda0be7a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.162816 Sep 06 12:35:41.485847 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2446/4874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:41 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:42.512313 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:42.513513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:42.522178 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:42.522729 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:42.523348 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:42.524322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:42.524974 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:42.525557 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:42.665855 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:42.673601 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b11ebfc4-135c-419b-9992-fc4d6a310b10 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1568 microversion: 2.1 time: 0.168703 Sep 06 12:35:42.674228 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2429/4875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:42 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:42.696247 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:35:42.696826 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:42.703834 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:42.704320 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:42.704760 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:42.705446 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:42.705954 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:42.706376 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:42.790676 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127122) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 12:35:42.861056 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b245cbd4-9754-4831-987e-98ffa0dd5e09 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "POST /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb/action" status: 202 len: 0 microversion: 2.1 time: 0.168083 Sep 06 12:35:42.861916 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2447/4876] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 6 12:35:42 2022] POST /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 12:35:42.869927 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:42.871842 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:42.881706 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:42.882515 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:42.883518 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:42.884513 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:42.885171 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:42.885832 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:43.032730 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:43.041266 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1d660a1e-206c-4d95-aa7d-45a25e31c792 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1516 microversion: 2.1 time: 0.175410 Sep 06 12:35:43.041881 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2430/4877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:42 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:44.066057 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:44.066854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:44.073264 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:44.073790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:44.074236 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:44.074947 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:44.075405 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:44.075835 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:44.220507 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:44.228511 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-e884873f-9ef6-4ae3-82a0-758597e04937 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1518 microversion: 2.1 time: 0.167315 Sep 06 12:35:44.229392 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2448/4878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:44 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:35:45.253141 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:45.253912 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:45.260279 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:45.260773 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:45.261212 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:45.261959 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:45.262419 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:45.263001 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:45.401812 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:45.411185 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-d32e4fab-6be9-4a45-a319-128034d4ab6a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.162671 Sep 06 12:35:45.411779 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2431/4879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:45 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:46.186444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-d1f414dd-cec5-43e3-aa15-1fdbfbcff7ab req-f131c102-1726-4e5b-8fab-03ac1b654b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "name": "network-vif-unplugged", "status": "completed", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:35:46.196836 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-d1f414dd-cec5-43e3-aa15-1fdbfbcff7ab req-f131c102-1726-4e5b-8fab-03ac1b654b68 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:46.197315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-d1f414dd-cec5-43e3-aa15-1fdbfbcff7ab req-f131c102-1726-4e5b-8fab-03ac1b654b68 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:46.197773 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-d1f414dd-cec5-43e3-aa15-1fdbfbcff7ab req-f131c102-1726-4e5b-8fab-03ac1b654b68 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:46.209149 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-d1f414dd-cec5-43e3-aa15-1fdbfbcff7ab req-f131c102-1726-4e5b-8fab-03ac1b654b68 service nova] Creating event network-vif-unplugged:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:35:46.215503 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-d1f414dd-cec5-43e3-aa15-1fdbfbcff7ab req-f131c102-1726-4e5b-8fab-03ac1b654b68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095719 Sep 06 12:35:46.216112 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2449/4880] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:35:46.434853 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:46.435454 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:46.442370 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:46.442852 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:46.443283 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:46.443969 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:46.444414 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:46.444831 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:46.575890 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:46.584336 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-4ea66ef4-8bef-41ab-ac1f-1cf3b25f2b1a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.153453 Sep 06 12:35:46.584915 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2432/4881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:46 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 12:35:47.610101 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:47.610822 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:47.616854 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:47.617342 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:47.617882 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:47.618573 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:47.619030 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:47.619457 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:47.756691 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:47.764477 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-ac573d1e-7d3b-4903-a1a0-284e61e9f234 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.159833 Sep 06 12:35:47.765050 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2450/4882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:47 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:48.788375 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:48.788989 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:48.795476 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:48.795961 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:48.796404 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:48.797332 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:48.798027 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:48.798256 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:48.929296 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:48.937082 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-229664af-d900-4d61-8c46-2c2fef8be9be tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.152617 Sep 06 12:35:48.938568 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2433/4883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:48 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:49.961296 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:49.961942 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:49.968330 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:49.968859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:49.969424 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:49.970148 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:49.970610 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:49.971034 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:50.105273 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:50.113902 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-3642a57d-8915-4734-af4c-216c63dd3802 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.156397 Sep 06 12:35:50.114487 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2451/4884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:49 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:51.136836 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:51.137575 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:51.144923 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:51.145405 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:51.145877 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:51.146576 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:51.147037 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:51.147470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:51.293883 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:51.302745 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-b9f4b252-2340-4700-ba3c-0adb5bd33621 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.169783 Sep 06 12:35:51.303334 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2434/4885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:51 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:52.326438 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:52.327073 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:52.334260 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:52.334739 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:52.335173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:52.335851 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:52.336298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:52.336716 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:52.476053 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:52.484737 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f9e4c437-4e77-4953-bbe9-03bab00ee09d tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.162018 Sep 06 12:35:52.485877 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2452/4886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:52 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:53.508384 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:53.508998 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:53.515438 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:53.516406 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:53.517449 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:53.518174 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:53.518633 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:53.519060 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:53.649123 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:53.657539 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6d84754c-a10f-4566-a46a-545aca061c8a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1574 microversion: 2.1 time: 0.152196 Sep 06 12:35:53.658290 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2435/4887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:53 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:54.680681 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:35:54.681298 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:35:54.687763 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:54.688315 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:54.688825 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:54.689517 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:54.690017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:54.690444 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:54.825418 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:35:54.833262 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-2c64f85d-b8c5-4b87-959e-d6414cb947cd tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1561 microversion: 2.1 time: 0.156428 Sep 06 12:35:54.833871 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2453/4888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:35:54 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:35:56.282799 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-fa433405-4cb3-4f4e-be2e-77d82bf95018 req-b1131943-fa8f-4570-95ed-be9f844d0f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "name": "network-vif-plugged", "status": "completed", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:35:56.294727 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-fa433405-4cb3-4f4e-be2e-77d82bf95018 req-b1131943-fa8f-4570-95ed-be9f844d0f7e service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:35:56.295201 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-fa433405-4cb3-4f4e-be2e-77d82bf95018 req-b1131943-fa8f-4570-95ed-be9f844d0f7e service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:35:56.295634 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-fa433405-4cb3-4f4e-be2e-77d82bf95018 req-b1131943-fa8f-4570-95ed-be9f844d0f7e service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:35:56.309271 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-fa433405-4cb3-4f4e-be2e-77d82bf95018 req-b1131943-fa8f-4570-95ed-be9f844d0f7e service nova] Creating event network-vif-plugged:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:35:56.317002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-fa433405-4cb3-4f4e-be2e-77d82bf95018 req-b1131943-fa8f-4570-95ed-be9f844d0f7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038338 Sep 06 12:35:56.318129 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2436/4889] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:37:31.847490 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:37:31.848572 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG dbcounter [-] [127122] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:37:31.851925 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 12:37:31.852835 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_api:SELECT=28 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:37:31.853429 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG dbcounter [-] [127121] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:37:31.854529 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:37:31.854892 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:37:31.855020 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:37:31.855154 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:37:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Sep 06 12:37:31.856349 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 12:37:31.856587 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Tue Sep 6 12:37:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Sep 06 12:37:31.864488 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:31.865355 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:31.865859 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:31.866896 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:31.867361 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:31.867790 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:31.901375 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Going to try to terminate instance {{(pid=127122) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 12:37:31.937571 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [req-6cd9eb1e-4e47-4f77-8449-6335d8389e74 req-d084c07c-ec65-4bdd-b4b6-b7a2b3c0f4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:37:31.949752 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6cd9eb1e-4e47-4f77-8449-6335d8389e74 req-d084c07c-ec65-4bdd-b4b6-b7a2b3c0f4a0 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:31.950239 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6cd9eb1e-4e47-4f77-8449-6335d8389e74 req-d084c07c-ec65-4bdd-b4b6-b7a2b3c0f4a0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:31.950670 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [req-6cd9eb1e-4e47-4f77-8449-6335d8389e74 req-d084c07c-ec65-4bdd-b4b6-b7a2b3c0f4a0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:31.963603 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.compute.server_external_events [req-6cd9eb1e-4e47-4f77-8449-6335d8389e74 req-d084c07c-ec65-4bdd-b4b6-b7a2b3c0f4a0 service nova] Creating event network-changed:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:37:31.969508 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [req-6cd9eb1e-4e47-4f77-8449-6335d8389e74 req-d084c07c-ec65-4bdd-b4b6-b7a2b3c0f4a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120102 Sep 06 12:37:31.970693 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2437/4890] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:37:31.993539 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-f75a61bf-8041-4498-b49f-f456fcc639ad tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 204 len: 0 microversion: 2.1 time: 0.147622 Sep 06 12:37:31.994435 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2454/4891] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 6 12:37:31 2022] DELETE /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 12:37:32.005161 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:37:32.006079 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:37:32.012777 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:32.013265 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:32.013719 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:32.014635 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:32.015095 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:32.015675 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:32.173908 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:37:32.182910 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-c2de6d89-8cad-4fe6-9584-7801b38ed05a tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.183460 Sep 06 12:37:32.183504 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2438/4892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:37:31 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:37:33.208370 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:37:33.208993 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.compute.api [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127122) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:37:33.217017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:33.217678 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:33.218017 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:33.218757 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:33.219220 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:33.219650 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:33.439867 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.policy [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127122) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:37:33.448396 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-a5d3cda2-0750-445b-93c4-de9928f1c9b0 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1567 microversion: 2.1 time: 0.245128 Sep 06 12:37:33.448979 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2455/4893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:37:33 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:37:34.474002 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:37:34.479470 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:37:34.482215 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:34.482709 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:34.483147 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:34.483851 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:34.484798 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:34.485222 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:34.494276 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO oslo.messaging._drivers.impl_rabbit [-] [81806981-6c29-40d9-bf12-0bc873136e2b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33270. Sep 06 12:37:34.566511 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.policy [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1102506cce6d4bd68d1af92fa8811fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e13494666564124bdf4007277a515d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127121) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 12:37:34.575246 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-6a063645-e3e0-4afb-b92c-be5122199ce6 tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 200 len: 1381 microversion: 2.1 time: 0.106207 Sep 06 12:37:34.575822 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2439/4894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:37:34 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 1381 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 12:37:34.593577 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [req-d266a754-9ac4-45f8-812e-962117347e9c req-dd8d9447-a72c-4090-a8d2-ef209bbc9fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bea0b7c-c6df-4cec-8841-173860a5deeb", "name": "network-vif-deleted", "tag": "c32795e4-872c-4f86-86d9-170e9d9317d7"}]} {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 12:37:34.605594 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-d266a754-9ac4-45f8-812e-962117347e9c req-dd8d9447-a72c-4090-a8d2-ef209bbc9fc0 service nova] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:34.606173 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-d266a754-9ac4-45f8-812e-962117347e9c req-dd8d9447-a72c-4090-a8d2-ef209bbc9fc0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:34.606626 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG oslo_concurrency.lockutils [req-d266a754-9ac4-45f8-812e-962117347e9c req-dd8d9447-a72c-4090-a8d2-ef209bbc9fc0 service nova] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:34.620808 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.compute.server_external_events [req-d266a754-9ac4-45f8-812e-962117347e9c req-dd8d9447-a72c-4090-a8d2-ef209bbc9fc0 service nova] Creating event network-vif-deleted:c32795e4-872c-4f86-86d9-170e9d9317d7 for instance 7bea0b7c-c6df-4cec-8841-173860a5deeb on hv-cinder-85604 Sep 06 12:37:34.628939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [req-d266a754-9ac4-45f8-812e-962117347e9c req-dd8d9447-a72c-4090-a8d2-ef209bbc9fc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110339 Sep 06 12:37:34.629939 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2456/4895] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 6 12:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 12:37:35.598705 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '>' {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:37:35.599322 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.compute.api [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] [instance: 7bea0b7c-c6df-4cec-8841-173860a5deeb] Fetching instance by UUID {{(pid=127121) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 12:37:35.605840 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:35.606377 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:35.606838 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:35.607631 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Acquiring lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 12:37:35.608112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 12:37:35.608544 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG oslo_concurrency.lockutils [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Lock "5389d5db-2fbe-430b-a0d6-b470d1cc30cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.wsgi [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] HTTP exception thrown: Instance 7bea0b7c-c6df-4cec-8841-173860a5deeb could not be found. Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Request method failure captured: Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: request: GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb HTTP/1.1 Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept: application/json Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Accept-Encoding: identity Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Connection: close Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Length: 0 Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Content-Type: application/json Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Host: 10.222.0.18 Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: Openstack-System-Scope: None Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: User-Agent: python-urllib3/1.26.12 Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Auth-Token: gAAAAABjFz3DrVbAeylno-5PfeDuhAgw1GRvOg_N5ezZr6raUcAfTciKxHFObpvDTf5hVns9fP2Xo3r8_wpnq2CJOkKs-ffaMPKvEG7Kz3xgnoQ_pu4RfWufTw2NUVnzbjhi0rtcN6IXTomgbzm6lycujQUsEkP7kdddKbMNdn8NeXwFvkdzifM Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Id: None Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Domain-Name: None Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Identity-Status: Confirmed Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Is-Admin-Project: True Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Id: default Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Domain-Name: Default Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Id: 4e13494666564124bdf4007277a515d6 Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Project-Name: tempest-TestShelveInstance-511380435 Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Role: reader,member Sep 06 12:37:35.625112 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Roles: reader,member Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4e13494666564124bdf4007277a515d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4e13494666564124bdf4007277a515d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4e13494666564124bdf4007277a515d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4e13494666564124bdf4007277a515d6"}]}] Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant: tempest-TestShelveInstance-511380435 Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Id: 4e13494666564124bdf4007277a515d6 Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-Tenant-Name: tempest-TestShelveInstance-511380435 Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User: tempest-TestShelveInstance-511380435-project Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Id: default Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Domain-Name: Default Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Id: 1102506cce6d4bd68d1af92fa8811fe3 Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: X-User-Name: tempest-TestShelveInstance-511380435-project Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: method: > Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: exception: Instance 7bea0b7c-c6df-4cec-8841-173860a5deeb could not be found. Sep 06 12:37:35.626911 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: action_args: {'id': '7bea0b7c-c6df-4cec-8841-173860a5deeb'} Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: {{(pid=127121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bea0b7c-c6df-4cec-8841-173860a5deeb could not be found. Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 12:37:35.627725 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bea0b7c-c6df-4cec-8841-173860a5deeb could not be found. Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bea0b7c-c6df-4cec-8841-173860a5deeb could not be found. Sep 06 12:37:35.629108 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: ERROR nova.api.openstack.wsgi Sep 06 12:37:35.630287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: DEBUG nova.api.openstack.wsgi [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Returning 404 to user: Instance 7bea0b7c-c6df-4cec-8841-173860a5deeb could not be found. {{(pid=127121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 12:37:35.630287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: INFO nova.api.openstack.requestlog [None req-1a0d5ba8-0e00-426f-b840-6a423c06eebc tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb" status: 404 len: 111 microversion: 2.1 time: 0.031820 Sep 06 12:37:35.630287 dv-cinder-856041-1-iscsi devstack@n-api.service[127121]: [pid: 127121|app: 0|req: 2440/4896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 6 12:37:35 2022] GET /compute/v2.1/servers/7bea0b7c-c6df-4cec-8841-173860a5deeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 12:37:35.795591 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: DEBUG nova.api.openstack.wsgi [None req-b95b428c-eea9-487c-ac9a-b7f036667a6c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] Calling method '.version_select at 0x7f97f4ee00d0>' {{(pid=127122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 12:37:35.823500 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: INFO nova.api.openstack.requestlog [None req-b95b428c-eea9-487c-ac9a-b7f036667a6c tempest-TestShelveInstance-511380435 tempest-TestShelveInstance-511380435-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2082497120" status: 202 len: 0 microversion: 2.1 time: 0.032372 Sep 06 12:37:35.824409 dv-cinder-856041-1-iscsi devstack@n-api.service[127122]: [pid: 127122|app: 0|req: 2457/4897] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Sep 6 12:37:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2082497120 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)